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Introduction 



It is possible to say that the research in statistical mechanics is in an histori- 
cal phase akin to that one in quantum mechanics at the beginning of the last 
century^. There is a lot to be studied and discovered, both in fundamentals 
and in applications. One fundamental point is in fact the range of application of 
the theory itself. Methods and concepts from statistical mechanics are starting 
to be currently used in scientific fields as different as e.g. biology [2J, economy [3J, 
information theory[4] and traffic engeneering[5! . Statistical mechanics, in fact, 
naturally proposes itself as a general framework to connect microscopic mecha- 
nisms and macroscopic collective behaviors. In condensed matter physics, quan- 
titative physical laws can be seen as emerging out of a statistical description of 
the dynamics of the microscopic units that form the system, or even out of that 
one of a simpler, coarse grained version of it. Nowadays, simple lattice models 
are widely used to gain a qualitative and often deeper understanding of physical 
phenomena. 

However, when a statistical mechanics perspective is adopted in fields dif- 
ferent from physics, an interesting point comes out. In many contexts, the 
structure of the interactions among the microscopic units can be often hetero- 
geneous nor embedded in a real dimensional space, and moreover, it can evolve 
in time. Thanks to the recent development of the numerical calculus power and 
of the memory resources in information technology, recent analysis show that 
the topology of graphs as different as social networks (friendship patterns, sci- 
entific collaboration networks, etc.) food webs in ecology, critical infrastructure 
like the Internet and so on, is truly heterogeneous and very complex (see [6] and 
ref . therein) . If the analysis of the structure of such complex networks requires 
statistical methods, the study of the dynamical processes occuring on them can 
get useful insights from statistical mechanics [7]- 

A good example is provided by the study of epidemic models in heteroge- 
neous networks [8]. The real networks on which these processes are taking place 
are in fact very heterogeneous, i.e. they are scale free. The dynamics of these 
processes in heterogeneous graphs can be ruled by the tails of the degree distri- 
bution. They can be in practice always in the infectuos phase and this is true 
e.g. for the spreading of viruses in large scale informatic systems. Interestingly, 
the paradigmatic Ising model has a dependence of this kind on the heterogeneity 
of the graph [9]. 

The general study of how the underlying topology affects the collective statis- 
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tical behavior of model systems is at the core of research in statistical mechanics. 
However, up to recent times this study was almost limited to homogeneous, or 
at least symmetrical structures of interactions, tipically d-dimensional or bethe 
lattices. The heterogeneity calls at identifying general mechanisms and unify- 
ing schemes in the dynamics of cooperative models on general heterogeneous 
graphs, since they can show truly different behaviors with respect to regular 
lattices. The focus of this thesis is about statistical mechanics on heterogeneous 
random graphs, i.e. how such heterogeneity can affect the cooperative behavior 
of model systems, but it is not intended as a general review on it. Rather, I will 
show more practically how this question emerges naturally and can give new in- 
sights for specific instances, in both physics and interdisciplinary applications, 
for equilibrium and out of equilibrium issues as well. 

The first chapter is devoted to the study of the congestion phenomena in 
networked queuing systems, like sub-networks of the Internet. After a brief in- 
troduction on the workings of the Internet, we will review the classic results of 
the queuing network theory, and the recent numerical results on congestion phe- 
nomena on complex networks. Then, I will show how to combine them within 
a minimal model that in practice extends queuing network theory in the con- 
gested regimepT]. With the use of network ensemble calculation techniques, it is 
possible to study the dependence of the traffic dynamics on the topology of the 
graph and on the level of traffic control as well, up to the possibility of drawing 
a mean field phase diagram of the system. We find many results. In particular, 
we find that traffic control is useful only if the network has a certain degree 
of heterogeneity, but, in any case, it can trigger congestion in a discontinuous 
way. Then, the second chapter is about the nature of the dynamical crossover in 
glass forming systems. After a brief review on the experimental phenomenology 
of the glass transition, we will do a short review on the theoretical perspec- 
tives on it. Then, I will show, within the framework of a simple facilitated spin 
model, how the question of the heterogeneity of the underlying spatial structure 
is crucial [53]. The dynamical arrest can change from a bootstrap percolation 
scenario to a simple one considering an heterogeneous lattice (e.g. diluted). 
This helps to shed lights on analogies and differences between the jamming of 
supercooled liquids and more heterogeneous systems, like polymer blends or 
confined fluids. The third chapter is on a general relationship between models 
and the underlying topology: how some specific features of the graph can induce 
inverse phase transitions in tricritical model systems. After a brief review on in- 
verse phase transitions, we will discuss the simplest model that reproduces this 
behavior, i.e. the Blume-Capel model with high degeneracy of the interacting 
states. I will show that tricritical model systems have this behavior if sparse 
subgraphs are crucial for the connectivity [70 . Within this framework, I will 
work out many results for the Blume-Capel model and give some insights about 
the fact that the random field ising model shares the same phenomenology. Fi- 
nally, the subject of the fourth chapter is on the co-evolving models of social 
networks. We will give a brief introduction to the field of social networks. The 
interesting point is that here the graph itself is subject to a dynamical evolution 
that can lead in turn to different states, with different connectivity properties. 
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The evolution of the network can be coupled to the dynamics defined on top of 
it, i.e. a so called co-evolution mechanism. I will show how the volatility, i.e. 
the rate at which nodes and/or links disappears, affects this evolution with a 
simple mo del [91] . Many results are found, in particular high node volatility can 
definitively suppress the emergence of an ordered, connected phase. 

In the conclusions there is a review of the results and I will point out a 
general insight about the statical mechanics of models on heterogenous random 
graphs, supported by specific examples took out from the cases we dealt with. 
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Chapter 1 



Statistical mechanics of 
queuing networks 



The Internet [10] is perhaps the most complex engineering system created in the 
human history. Its exponential growth has played a pivotal role in the recent 
surge of interest in the study of complex networks. It is not a static system, 
rather it evolves according to a self-organized and decentralized dynamics. The 
structure)!!] and the properties of traffic dynamics [12] it supports show a very 
rich phenomenology. The basic theory to analize traffic dynamics of information 
processing networks, queuing network theory, relies on the simplifying hypoth- 
esis of stationarity. This theory is mainly used to investigate single cases of 
small systems whose structure does not change. Statistical mechanics can ex- 
tend this theory, allowing the investigation of congested states and the general 
study of the effects of topology and of traffic control on the traffic dynamics. In 
this chapter, after a brief introduction on the structure and traffic dynamics of 
the Internet, I will review the main results of queuing network theory [13] and 
the recent results in congestion phenomena on complex networks(see table 6 
in|12j). Then, in the final paragraph, I will show how to combine them togheter 
within the framework of a minimal model, that allows the study of congestion 
in queuing network systems up to the possibility of drawing mean-field phase 
diagrams [Hj. We find many general results, both theoretical, e.g. I will show 
analitically the presence of a dynamical phase transition in queuing networks , 
and of practical importance, e.g. I will show that traffic control is useful only 
in heterogeneous networks. 



1.1 The Internet 



The Internet was originally conceived for experimental reasons within a military 
project in the '60 of the last century. This network of networks of computers 
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has nowadays a worldwide extension, connecting hundreds of millions of hosts 0, 
through which users can communicate in real time, sell and buy goods, exchange 
and share music, videos, informations, etc. The handling of the information 
flows is the result of a complex interplay of different rules, protocols and devices 
acting at different levels. These levels go from the physical one (the transport 
of electrical signals along wires or optical fibers) to that one of applications 
(e.g. the standard SMTP protocol to forward e-mail) , usually without common 
standards all along the network. 

The Internet is a network of networks: hosts are joined together by switches 
in LAN (local area network) or WAN (wide area network) , and the exchange of 
information among these networks is provided by specific devices called routers, 
forming a network that represents the physical connectivity of the Internet. 
Routers are themself grouped together in autonomous systems (AS), i.e inde- 
pendently administered domains. The traffic at the network (routers) level is 
ruled by the TCP/IP (transmission-control protocol/Internet protocol), perhaps 
the only common standard protocol in the Internet: 

• The information is framed in discrete units, called IP packets. The packet 
has a part devoted to the addresses of source and destination. There is a 
common address space for all the network. 

• All the packets are routed independently by the routers. Each router has 
a list of paths, i.e. a kind of coarse-grained map of the network. It sends 
packets to its neighbors along the shortest path. 

• Routers exchange continuosly informations on the topology of the network, 
signaling damages, outages, etc. 

• Each single transmission between neighbouring routers is ruled by the 
TCP protocol through the exchange of check and confirmation signals 
(ACK acknowledgements signals). A delay of ACK signals induces an 
halving of the packets' sending rate along that line of transimission (window- 
based congestion control mechanism). 

The overall structure, at each level, is self-organized and evolving. The network 
of routers changes continuosly, the nodes and the links being removed or added 
according to the reasons (mainly of economical nature) of single providers and 
not by a central authority. Therefore, it is hard to monitor the topology of such 
a graph, that is still partially unknown. 

Fig ll. II shows the degree distribution of a sub-network of the Internet mon- 
itored within the CAIDA project 15 . The curve is well fitted by a power-law 
with an exponent between 2 and 3. For a power law distribution P(x) oc x 1 , 
we have d ^f gff ~7j independently of y, and moreover, if 7 < 3 the error 
on (x) is not defined. The networks with a power law degree distribution with 
an exponent 7 < 3 are thus called scale free. Dynamical processeses defined on 



1 An host is a device connected to the Internet, with its own address, that can inter-operate 
with other hosts 
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Figure 1.1: Degree distribution and complementary cumulative distribution of 
a subnetwork of the Internet at routers level monitored within the CAIDA 
project [TS] 



them can show qualitative change with respect to homogeneous networks 0, as 
we will point out later in this chapter about congestion phenomena. It seems 
that the scale-free degree distribution characterizes the Internet graphs at many 
scales, from the routers to the AS level|ll|. This finding has attracted many 
research efforts on the Internet structure [16] . 

There are few stilizyed facts about traffic dynamics, the main being the self- 
similarity of inter- arrival time signals [17l. Looking at the temporal evolution 
y(t) of the time spent by a signal to travel along a given path in the network 
under controlled conditions it is found that the self correlation function 



C(r) 



{{y(t)y(t + T))-(y)< 

(y 2 ) W 



(1.1) 



• is unsummable | C (z) | — > oo 

• and has a power-law tail C (r) oc t~ 
Moreover: 



The scaling of the variance of the coarse-grained signal over intervals M 
times larger £(m(*) = jj J2l=t-M v{i) IS not normal, i.e. a 2 M = 



There are many different ways to define and measure these features. They 
seem to be independent of the path, the time of measure and the level of traf- 
fic. There are many ways to interpret them. The robustness of these features 
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has attracted several modeling efforts to interpret it as a signature of the fact 
that the network is working at criticality between a free and a congested phase 
through a self-organized mechanism of some kind, as we shall see in the next 
paragraph. But self-similarity is even too robust for this mechanism at work: 
it is still present even for low level of traffic load, far out from the congested 
regime. Therefore, the most accepted explanation for the self-similarity of inter 
arrival times signals relies on the heterogeneity and strong correlation in time 
of the demand itself |18|. In fact, many packets can belong to the same request, 
with a distribution of the flows' sizen that is heterogeneous itself. 

Apart from this, even if this network mostly works in the free regime, time 
delays and packets' loss continue to threaten Internet pratictioners, because 
some parts of the network can be sometimes in the congested regime. However, 
congestion events are difficult to monitor and study, and a clear phenomenolog- 
ical picture is still missing. This calls for a theoretical understanding of what 
happens above the threshold at which a queuing network system can work. 

1.2 Models of network traffic dynamics 
1.2.1 queuing network theory 

The classical framework used to study performances of information process- 
ing and/or service delivering networked systems is queuing network theory 
(QNT) 13 j. Its applications range from the study of costumers forming queues 
in banks and offices, to the study of data traffic in packet switching networks of 
routers in communication systems. 

The main model is the Jackson or open queuing network|19). consisting of 
N nodes such that: 

• each node i is endowed with a FIFO (first-in first out) queue with unlimited 
waiting places (it can be arbitrary long). 

• The delivery of a packet from the front of i follows a poisson process with 
a certain frequency (service rates), and 

- the packet exits the network with some probability fii , or 

- it goes on the "back" of another queue j with probability . 

• Packets are injected in each queue i from external sources by a Poisson 
stream with intensity pi . 

The state of the system is specified by the vector n = (ni, ...,rijv), where 
rii is the i'a queue length. If we indicate with i the vector with all components 
equal to zero, apart from the i th that is equal to one, we have the expressions 



2 A flow is a group of packets within the same request 
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Figure 1.2: queuing network: pi creation rates, service rates, fa absorbing 
rates, routing probabilities 



for the transition ratet[f|: 



W(n -> n + i) = pj 
W(n -> n - i) = r iy u 4 
W(n -> n - i + j) = n(l - fn)qij. 



(1.2) 
(1.3) 
(1.4) 



The master equation for the probability distribution of states P(n) reads: 

p(n) = ^ W(n' -> n)P(n') - ^ W(n n')P(n). (1.5) 



QNT studies the stationary state, assuming it exists: P = 0. How we see next, 
the probability distribution factorizes P(n) = Y[iPi( n i)- By using this form of 
the distribution as an ansatz to solve the master equation, we find: 



Pi(n) = (1 - Xi)xf, 



(1.6) 



where Xi — A; /r,; . Here the coefficients Ai , the average packet flow towards node 
i, can be found on specific networks solving the set of linear equations: 



A* =P» + 53<Zji(l-w)Aj 



(1.7) 



'In the second and third equations n, > 
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The framework of QNT can easily accomodate modifications. For instance, 
it is possible to think of finite size capacity for the queues, queue length state 
dependent service rates and/or transition probabilities. It is possible to study 
closed instances, with a given number of packets K that are not generated nei- 
ther absorbed. QNT has many practical applications in very different contexts, 
from telecommunications networks to the scheduling design of factories, hospi- 
tals, ecc, and, moreover, it can give interesting insights to theoretical research. 

For instance, there was a recent debate[21] about the scaling of fluctuations 
of the Internet time series. Looking at the time series of the amount of bytes x(t) 
processed by a router, it is found that a oc (x) 7 , with 1/2 < 7 < 1, depending 
on the aggregation time, and/or crossover between these limits. This can find 
a nice and natural explanation within QNT. In fact, if x follows an exponential 
distribution, as is the case for most of the queuing networks, it is a 1 = (x) + (x) 2 , 
and (x) can vary by aggregating times, mimicking exponents between 1/2 and 
1. 

The main limitation of this theory is in the stationarity assumption. It gives 
for guaranteed that, given a certain external demand p = (pi, ...,pjv), we are 
always able to build a network such that Xi < rt . It basically avoids completely 
the study of congested states, in which queues can grow out of stationarity. It 
should be noticed that in self-organized evolving networks, like the Internet, the 
external demand may change on times faster than our capacity to modify the 
network to mantain stationarity. This can trigger congestion phenomena, that 
are interesting to study from a theoretical point of view. 



1.2.2 The congestion phase transition 

Apart from this theory, the recent years have witnessed the proposal of several 
models of interacting particles hopping on graphs, to study the interplay of 
topology and routing strategy on the performances of networked systems in 
processing information (see table 6 in|12j). 

In all these models packets are injected into the network with some rate 
P, they have to travel between given sources and destinations, where they exit 
the network, and they interact by forming queues. Can all the packets reach 
their destinations, or, alternatively, can the network process all the incoming 
information (quantified by P)l If it can do it, the total number of packets 
N(t) will be stationary in time, if it cannot, N(t) will be growing in time. A 
good parameter to distinguish these two different phases is the average queues' 
growth rate divided by the average rate of incoming packets, i.e. the percentage 
of packets trapped in queues [22]: 

,= f. (1.8) 



By studying the curves p(P), once the network and the routing strategy are 
given, it is possible to distinguish two phases: p — (free flow) and p > 
(congestion), clearly divided by a point P c . Upon approaching this point from 
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the free phase, the self-correlation in time of the queues' length starts to develop 
fat tails. This was seen as an elegant explanation of the self-similar character 
of real time series. However, as it was previously stated, self-similarity in a real 
network is present even far out of the congested regime. Anyway, all these works 
show the inherent presence in queuing networks of a dynamical phase transition 
towards congestion. 

The numerical investigation of the dependence of such a transition on the 
structure of the graph and on the routing strategy, shows interesting phenomena. 
One of the most interesting is the apparent tricritical character of the congestion 
transition in queuing network systems. In[23 the authors propose the following 
model: onto a given network, packets arrive from external source with rate P on 
random nodes, each packet has its destination d, and it hops from the current 
node i to the neighbor j such that the quantity: 

wj = djdh + n,j{l — h), (1-9) 

is minimum. There djd is the distance between j and d, rij is the number of 
packets sitting on j, h is a parameter that quantifies the level of congestion 
control (h = 1, no congestion control, shortest path routing). This mimick 
an attempt to minimize travelling times instead of distances with the use of 
local information. The authors did simulations on a realistic instance, i.e. the 
Internet network at autonomous system level. They found that a certain level 
of traffic control can avoid the transition up to a certain point, after which 
congestion is triggered in a discontinuous way, i.e. upon decreasing h, P c is 
growing, but exactly at P c , p jumps from to a finite value (see fig ll.3|) . 

This approach to network traffic based on the dynamics of individual par- 
ticles has the problem of not being amenable to analytic approaches. These 
models become analitically tractable considering a randomization of the tra- 
jectories. The reach of a destination by a particle should be mimicked in a 
probabilistic way, i.e. during the hoppings the particle can be absorbed with 
some probability. This defines a framework very similar to the QNT, that I will 
analize in detail in the next paragraph. 

1.3 Statistical mechanics of congestion 

I will review the model in ref.|14l. It consists of particles hopping randomly 
among the nodes of a graph such that: 

• They form queues, 

• They are created with a certain rate. 

• They have a certain probability of being absorbed during the hoppings. 
Then we will mimick a protocol of congestion control in the following way: 

• The node j starts to reject particles with probability fj once its queue is 
longer than n*. 
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Figure 1.3: Congestion parameter curves p(P) from simulations of a particle 
hopping model on the Internet at level of AS graph, from|23j. 



This model of particles corresponds to a queuing network such that: 

• The hopping probability from node i to node j is qij = 1 Sfffea — IlJ. ai j4] 

• A certain set of values r^pj, /x, for the service rate, demand and adsorbing 
probability of the node i, respectively, is given. 

Here is the adjacency matrix of the graph and ki the degree of the node 
i. The important difference from the Jackson framework is that packets have 
to move to be absorbed. They are absorbed during the hoppings and not when 
they are stored in the queues. Within this new framework, it is possible to 
extend QNT beyond stationarity. There are two phases (see fi.g il.4P : as the 
demand increases the system pass from a free phase, in which the number of 
particles is stationary, to a congested phase, where it is growing. 

There is a phase transition between them, whose nature depends on the 
topology of the graph and on the level of traffic control. This is shown in fig |1.51 
which reports simulations on homogeneous and heterogeneous graphs, with low 
and high level of traffic control. The curves p(p) suggest that an high level of 
traffic control trigger the transition in a discontinuous way and can displace the 
transition point to higher values of p only in the heterogeneous case. 

In order to study the generality of such results, I will exploit the QNT 
formalism, combined with the use of techniques from statistical mechanics. The 

4 9(x) is the step function, i.e. it is 1 for x > 0, otherwise 
5 aij is 1 if j and j are connected by a link, otherwise 
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Figure 1.4: Number of packets as a function of time for an homogeneous network 
of 10 3 nodes, degree K — 4, without routing procol (fj = 0), with homogeneous 
condition n = 1, [i% = [i = 0.2, in the free (pi = p — 0.05) and congested phase 
(p = 0.25). 



transition rates are: 



W(n -> n - i) = Tj 



PF(n — > n + i) = pi 
HiO- - n0{nj)) 



(1.10) 

(1.11) 



W(n -> n - i + J) = n(l-/ff)(l-^(r»j)) 



(1.12) 



We work with the approximation of a factorized form for the probability 
distribution function P(n) — YiiPifoi)®- 

Imposing detailed balance Pi(ni)W(rii — > n« + l) = pi(rii + l)W(ni+l —> rii), 
we can express the single point distributions Pi(rii) in terms of the the two local 
quantities qi = Pi(0) and \i — Prob(rii > n*). We have 



v-i 1 — rjOfrii — n*) 
W(n t -> m + 1) = Pi + (1 - fij) y j rjqj : a,: 



w( ni + i ->«••) = £• £(i -tc) 



(1.13) 
(1.14) 



6 It works exactly for = because this is equivalent to the Jackson network. See appen- 
dices in the second reference of ref. 1 141 for a discussion about the extension of its validity. 
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Figure 1.5: Top: Transition curves p(p) for a random regular graph of size 
N = 10 4 , n = 0.2, fj = 0.1, fj = 0.9. Bottom: Transition curves p(p) for an 
uncorrelated scale free graph with 7 = 3, k m i n —2oiN — 3.10 3 nodes, /i = 0.2, 
fj = 0.1, fj = 0.9 for n* = 10. For r/ = 0.9 the system shows hysteresis in both 
the homogeneous and heterogeneous case. 



Then, the average growth of the queue lcnght of node i is: 

(A*) = Pi +(i-Mi)(i-TO) E°tf rj( V" ^ -^D 1 -^-- ( L15 ) 

j j 
The equations for the (?i,Xi come from: 

• The normalization conditions ^2 n . Pi(ni) — 1. 

• The stationarity of queues'length (rij) = 0. 

If the second condition gives not physical results, we have that qi = 0, \i — lj 
from which we can calculate (rii). This can be summarized in terms of the linear 
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set of equations 



where 



Xi = max{0,mm[l,Cj(x,g)]} (1.16) 

q t = max{0,min[l,Qi(x,<7)]}, (1-17) 

Pi - ''. ^ L ,"-.;'/ V; 

Ci(x,g) = - 1 + 7i Ti wT ■ ( L19 ) 



»7 



(1 ~ Hi)Y,j a n r i{ 1 - <lj)l k i 



For sake of simplicity we consider from now on pi = p, = 1 and /ij = /i. 

1.3.1 Network Ensemble calculations and results 

We consider an uncorrelated random graph with a given degree distribution 
P{k). This is a graph taken from the ensemble of all the graphs with a given 
degree distribution, all with equal statistical weights. If we have N nodes i = 
1 . . . N, it is possible to build a graph of this kind along these lines (configuration 
model [23]): 

• We extract the degree fcj of each node i randomly according to the desired 
distribution P(k). 

• Each node i has fej ste&s dangling from it. We randomly match these 
stubs, taking care to avoid tadpoles and double linktQ- 

A typical network of this ensemble has locally the structure of a tree, such that 
dynamical processes defined onto it can be successfully approximated with the 
use of mean field techniques. In particular, for our model, we will make the 
hypothesis that all the nodes with the same degree have the same statistical 
dynamical features. 

The mean field rates for the queue length of a node with degree k are H: 

k 

w k (n-tn + l) = p+ (1 - /i)(l - q)-(l - f]0(n - n*)) 

z 

w k (n^n-l) = 0(n)(l-x), (1-20) 

where z is the average degree, q = ^Z k qkP{k) and x = J2k XkP(k)- The 
average queue length (rife) follows the rate equation 

(n fc )=p + (l-/i)(l-«)-(l-x*)-(l-fffc)(l-x). (1-21) 

z 

Note that summing over k and dividing by p we obtain a measure of the order 
parameter p(p). 



7 This can introduce undesired correlation, see !24| 

8 We have absorbed for sake of simplicity the f\ in the definition of the \ 
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Since hk depends linearly on k, high degree nodes are more likely to be 
congested, therefore, for every p, there exists a real valued threshold k*(p) such 
that all nodes with k > k* are congested whereas nodes with degree less than 
k* are not congested. Congested nodes (k > k*) have qk = and \k = V- The 
probability distribution for the number of particles in the queue of free nodes 
with degree k < k* can be extracted by calculating the generating function 
Gk(s) = ^nVkint = n)s n from the detailed balance condition Wk(nk + 1 — > 
nk)Vk(nk + 1) = w(nk —t Ufc + l)Vk(nk)- The generating function takes the 
form 

G k (s) = q k li-S^f + fef£ | (1.22) 
1-afeS l-(a fc -6fc)sj 

corresponding to a double exponential, where a k — \p + (1 — p) ~(1 — ?)]/[! — x] 
and 6fe = r?[(l — /i)^(l — — x]. From the normalization condition Gfe(l) = 1 
and the condition nfc = 0, we get expressions for qk, Xki 



'Ik 



1 - a? 



1 - ak 1 - a k + b k 



(1.23) 



= p -(i- gfc )(i (L24) 

and, finally, for q, \- 

The value k* is self-consistently determined imposing that nodes with k = k* 
are marginally stationary, i.e. hk* — with qk* = 0, \k* — fj, that translates 
into the equation 

^ a-rid-w-,) '- <L25) 

The set of closed equations for q,x can be solved for any degree distribution 
P{k) and p(p) can be computed accordingly. 



Homogeneous networks 

The equations for q and x simplifies to a single equation when all nodes have 
the same properties, and in particular the same degree (ki = K, Vi). On these 
networks, the mean-field behavior can be trivially studied for any value of n* , 
but we consider as an illustrative example the limit n* — > oo. Only two solutions 
of the equation relating q and x are possible: the free-flow solution (p = 0) with 
q = 1 — p/fi and x = that exists for p < fi, and congested-phase solution, 
where all nodes have rij — > oo, i.e. x = fj and g = 0. The latter solution has 
p = ri/p = 1 — (1 — fj)fi/p and exists for p > (1 — ^)/i. The behavior of the 
congestion parameter with both the continuous and discontinuous transitions 
to the congested state is plotted in Fig. 11.61 for fj = 0.25, 0.75. The corre- 
sponding phase diagram, reported in the inset of Fig. II. 6[ shows that in the 
interval p £ [(1 — fj)p,, /i] both a congested- and a free-phase coexist. We find an 
hysteresis cycle, with the system that turns from a free phase into a congested 
one discontinuously as p crosses fi. It reverts back to the free phase only at 
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Figure 1.6: Behavior of the congestion parameter p(p/fi) for a random regular 
network for i] = 0.25, 0.75. Inset: phase diagram for the same graph. 



p = (1 — rj)fi as p decreases. It is interesting to observe that in the homogeneous 
case the transition is always discontinuous until there is traffic control fj > 0. 

Heterogeneous networks 

In the case of heterogeneous networks the equations for q and % have to be solved 
numerically. For instance, in Fig. 1 1.71 we compare the theoretical prediction (full 
line) for in a scale- free network with results of simulations (points). The 
agreement is good, the theoretical prediction at the ensemble level confirming 
the scenario already observed in the simulations. The curves are obtained for 
p = 0.2 and n* = 10, but the behavior does not qualitatively change for different 
values of these parameters. The dependence on fj brings instead qualitative 
changes. Increasing fj from 0.1 to 0.9, the transition becomes discontinuous and 
p c increases. 

The main difference with respect to homogeneous networks is that not all 
nodes become congested at the same time. The rate p at which a node becomes 
congested depends on its degree, the hubs being first. The process governing the 
onset of congestion and the effects of the rejection term can be understood in the 
limit n* — > oo, that simplifies considerably the calculations without modifying 
the overall qualitative behavior for sufficiently large n* . We have to solve in 
the limit n* — ¥ oo the self-consistent equations for \ and q. In this limit, 
uncongested nodes have a& < 1, hence \k — ► and qt = 1 — a&- All nodes 
with degree k < kp, where kp — max(fc* (1 — fj), k m i n ), are free from congestion. 
Congested nodes have qu — > and Xfc = V (for k> k*). In addition there are 
also fickle nodes, which are those with kF < k < k* and \k = 1 — % ■ Using 
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Figure 1.7: p(p) for an uncorrelated scale-free graph (P(k) oc k 3 , k m in = 2, 
k max = 110, N = 3000), Ai = 0.2, n* = 10 and fj = 0.1 and fj = 0.9, from both 
simulations (points) and theoretical predictions (lines). Hysteresis is observed 
increasing (black curve and points) and then decreasing (red curve and points) 
p across the transition. 



this classification, we get a first expression for x, i-e 
k* r , -i , k 

Xi 



E 

k — kfr 



1 



kp 
T 



7 romax l 

-P(k) + fj V -P(fc). 



(1.26) 



Eq. (|1.25p provides a further relation between q, \ an( i k* . We eliminate q 
using its definition which leaves us with another expression for x, 

X2 = l-^{l + Ap-B+[(l + A P -B) 2 + AABp] 1/2 } (1.27) 

where A = z/[k*(l - fj)(l - fi)] and B = J2k=k mm 1 ~ IT To determine 

X we have to solve the implicit equation xi = X2- 



In Fig. 11.81 we plot the difference Ax = Xi — X2 vs. k* , for fj — 0.1 
(left) and 0.9 (right) and different values of p on a scale-free graph. The zeros 
of Ax{k*) correspond to the only possible values assumed by fc*. For small 
rejection probability (fj = 0.1 in Fig. II. 8[) . there is only one solution k*(p), 
which decreases from +oo when increasing p from 0. The value p c at which 
k*{p c ) — k max is the critical creation rate at which largest degree nodes become 
congested. At larger p, k*(p) decreases monotonously until eventually all nodes 
are congested when k*(p) = k m i n . Hence for low values of fj, the transition from 
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Figure 1.8: The zeros of Ax(p) vs. k* define the threshold degree for the onset 
of congestion in a network. The picture refers to a scale-free random network 
with 7 = 3.0, k m i n = 2 and N = 3000 (k max = 110), and different values for 
?7 = 0.1 (left) and 0.9 (right) and p. The solution k*{p) in the right panel falls 
outside the plot. 



free-flow to the congested phase occurs continuously at the value of p for which 

k (p) = kmax- 

At large fj (fj = 0.9 in Fig. I1.8[) . the scenario is more complex. Depending on p, 
the equation can have up to three solutions, k*(p) < fc^Cp) < k^(p). It is easy 
to check that only k\ and fcj can be stable solutions. For p« 1 there is only 
one solution at k$ (p) 3> k max , corresponding to the free phase. This is thus 
the stable solution for p increasing from zero. As p increases, another solution 
kl(p) < k^(p) can appear, and k^(p) moves towards lower degree values. Three 
situations may occur: 

i. The solution k% (p) disappears before reaching k max . Then k\ (p) becomes 
the stable solution, and the congested phase appears abruptly. However, 
given the shape of the function Ax (see Fig. 1 1 . 8[) . when this happens 
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k\(p) — > and in particular we expect k*(p) < k min , so that above the 
transition the whole network is congested and follows the law p(p) = 

ii. The solution fcg (p) crosses k max and exists until it reaches k m i n . Then the 
congested phase emerges continuously and the network is only partially 
congested (i.e. only the nodes with k > k^(p)). The order parameter 
grows until it reaches the curve of complete congestion p{p) = 1 — (1 — fj)^ 

(^3 \P) ^mm)- 

Hi. The solution fcj (p) crosses k m ax but disappears before reaching k m in , and 
k\ becomes the stable solution. In this case the congested phase appears 
continuously (only high-degree nodes are congested), but at some point 
another transition occurs that brings the system abruptly into the com- 
pletely congested state. 

In general, the exact phenomenology observed in the mean field and simula- 
tions depends strongly on the tail of the degree distribution, i.e. on the graph 
ensemble considered. 

Note that in case of discontinuous transitions, the presence of an hysteresis 
phenomenon is associated to the stability of the two solutions k\(p) and k^(p). 
For instance, in case ii or Hi, we start from the free-phase at low p, the system 
selects the solution k^(p) and follows it upon increasing p until the solution 
fcgG?) disappears. On the contrary, starting from the congested phase (large p) 
the system selects the solution k*(p) and remains congested until this solution 
disappears (see inset of Fig. 11.71) . 

In Fig. I1.9l we can see the solution k*(p) for the same graph of Fig jl.71 with 
fj = 0.7: at pi, when k* = k max , the system becomes congested in a continuous 
way, at p^ there is a discontinuous jump to higher values of congestion, while 
above p^ the network is fully congested and finally, coming back to pi there is a 
jump to a less congested state. Between pi and ps there is coexistence of high 
and low congested states with hysteresis. 

In summary, the system can show a sort of hybrid transition: a continuous 
transition to a partially congested state followed by a discontinuous one to a 
(almost) completely congested one (see Fig ll.lOp . 

On heterogeneous random graphs, the behavior of the system in the plane 
(?7,p) depends in a complex way on its topological properties, such as the degree 
cut-off and the shape of the degree distribution. For this reason the precise 
location of the critical lines, separating different phases, can be determined only 
numerically using the methods exposed in the previous section. In the following, 
we give a qualitative description of the general structure of the phase diagram 
in the limit n* — > oo, then we substantiate the analysis reporting an example 
of phase diagram obtained numerically for the same networks ensemble of Fig. 

A first important region of the space of parameters is the one in which a 
completely free solution exists, i.e. k max < kp. This solution is characterized 
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Figure 1.9: The solution k*(p) for the scale-free graph of Fig ll.71 with 77 = 0.7. 
At Pi, k* — k max , and the system becomes partially congested in a continuous 
way. Between P2 and P3 there are three solutions, two of them are stable. 
Increasing p, the system jumps suddenly to a more congested state at p% , whereas 
decreasing p, the system jumps to a less congested state at p2- Above p^ the 
system is completely congested. 



by (7=1— p/fi, x = and p — 0. From the expression for fik = computed in 
kmax we find that this happens as long as p < p Co with 

Pco = —z - rg ■ (1-28) 

Note that this region does not depend on the rejection probability fj, because 
rejection affects only congested nodes. 

The transition takes place when the maximum degree nodes first become 
congested, i.e. k* — k max . Since fik* — 0, qk mam = and Xk ma x — V? we S e t 
from Eq. 11.211 a first expression for p c — 1 — \ — km z a=c (1 — /i)(l — 77) (1 — q). 
Now computing p averaging Eq. 11.211 and imposing p = 0, we find a second 
expression for p c = p(l — q)(l — x). Eliminating q from these two equations, we 
find the critical line 

fl - \) 2 

PM = T i (1-29) 

where x = J2k>k F kP ^ (l — izsaail^Sij. Below this line (dotted line in Fig. 
II. lip the system is not congested (p = 0), even if in the region p Co < p < p c (fj) 
higher-degree nodes are unstable (kp < k max < k*). 

It is possible to show that p c (fj) attains its maximum in fj c = 1 — jr m '" where 
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Figure 1.10: Increasing fj, the congestion parameter p{p) develops a discontin- 
uous transition. Here we report the case of the graph of Fig ll.8l For ?/ = 0.75, 
we have first a continuous, then a discontinuous transition. 



Pcmax = fi km z in , where kp = k min and so above this point the curve is constant 
Pc(v > fj c ) = p c (fjc)- 

The transition line p c {fj) corresponds to the point pi in Fig. 11.91 calculated 
for all values of fj. We can calculate the two curves P2(fj), P3{v) as well, in 
order to get the points at which there are discontinuous jumps in the congestion 
parameter p(p). 

Looking at Fig. 11.111 we can distinguish three points A, B, C dividing the 
phase diagram into different regions: 

i. Below fjA we have a continuous transition to a congested state increasing 
p above p\ . 

ii. Between fj^ and fjs the transition is continuous at p\ . Then, increasing p 
above p^, there is a discontinuous jump to a more congested state. Coming 
back to lower values of p, there is a discontinues jump to a less but still 
congested state at p%, and the system eventually becomes free below p\ in 
a continuous way. 

Hi. Increasing p in the region between t)b and fjc, there is a continuous tran- 
sition from free- flow to a congested state at p\, and a sudden jump to a 
more congested phase at ^3; but, this time, by decreasing p from the con- 
gested state, the transition to the free phase is discontinuous and located 
in p 2 . 

iv. For fj > fjc the transition is a purely discontinuous one with transition 
points P2 and p^. 
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Figure 1.11: (rj,p) phase diagram for the uncorrelated scale-free graph of Fig. 
PI 



Increasing p above the transition, at some point p ci (ry) the system becomes 
completely congested. For p > p ci (fj), the order parameter follows the curve 
p = 1 - /i(l - T))/p. This happens for p > p ci (fj) = (1 - fj)(l - (1 - /j,)k min /z), 
where fc* < fc min , g = 0, x = »7- 

These calculations show that the phase diagram crucially depends on the tail 
of the degree distribution. In scale-free networks k max scales with the network's 
size N as N^ with ui = 2 (structural cut-off) or ui = 7 — 1 (natural cut-off). 
Accordingly the critical line depends on the system's size, p c oc N~^ . The only 
region that does not depend on k max is the one for fj > fjc- 



1.3.2 Conclusions 

The model discussed above, inspired by the recent literature on congestion on 
complex networks, basically extends the classic framework of Jackson queuing 
networks along three lines: 

• It goes beyond stationarity, exploring congested regimes, where the queues 
can grow. 

• It accounts for congestion control protocols and this requires that the 
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absorption of packets takes place during the hoppings and not within the 
queue. 

• It exploits graph ensemble calculation techniques, allowing the study of 
how traffic is affected by the general features of the underlying network. 

Within this framework it is possible to obtain transition curves and phase di- 
agrams at analytical level for the ensemble of uncorrelated networks and nu- 
merically for single instances. We found that traffic control improves global 
performance, enlarging the free-flow region in parameter space only in hetero- 
geneous networks. In very heterogeneous networks, e.g. with scale-free degree 
distribution, its role should be crucial, since for low enough traffic control the 
critical packets inserction rate per node goes to zero with the system size. Traffic 
control introduces non-linear effects and, beyond a critical strength, may trigger 
the appearance of a congested phase in a discontinuous manner. This work can 
be extended in several interesting directions. First, it should be interesting to 
study how the dynamics change once considering a bias in the random rout- 
ing, e.g. an hoppingprobability proportional to the betwennes centrality of the 
neighbouring nodeqj, to better mimick shortest path routing. The possibility 
of solving the model on a given network with realistic parameters could provide 
both specific predictions for the robustness of the network to traffic overloads 
and important hints for the design of systems less vulnarable to congestion. 
The dynamical environment created within this model could be also axploitcd 
as a framework for testing the statistical properties of single particle dynamics 
under more complex routing schemes, like the study of tracking particles in hy- 
drodynamics. Finally, it would be interesting to model the complex adaptive 
behavior of human users in communication networks, such as the Internet, by 
introducing variable rates of packets production in response to network perfor- 
mances. It is known that users face the social dilemma of maximizing their own 
communiction rates, maintaining the system far from the congested state [25] . 
In such a situation, the presence of a continuous transition may allow the sys- 
tem to self-organize at the edge of criticality, whereas a discontinuous transition 
may have catastrophic consequences. 



9 The betweermes centrality of the node i is J^j^i kjti "n^/fc)^ ' where n (h i s the number 
of shortest paths between j and k, and n(j, k, i) is the number of them that pass through i. 



Chapter 2 



Dynamical arrest on 
disordered structures 

"The deepest and most interesting unsolved problem in solid state theory is prob- 
ably the theory of the nature of glass and the glass transition. This could be the 
next breakthrough in the coming decade. The solution of the problem of spin glass 
in the late 1970s had broad implications in unexpected fields like neural networks, 
computer algorithms, evolution and computational complexity. The solution of 
the more important and puzzling glass problem may also have a substantial in- 
tellectual spin-off. Whether it will help make better glass is questionable" . 
P.W.Anderson, Science (1995). 

Fifteen years have passed since this statement, and the dramatic slowing 
down of the dynamics of glass forming systems is still puzzling us 26 . Its study 
requires a deep reasoning on the fundamentals of statistical mechanics, and 
methods and concepts developed in this field are likely to become paradigms 
for the study of complex systems in general. In this chapter I will show how a 
certain degree of fixed heterogeneity, e.g. in the underlying spatial structure, 
can change the character of the jamming transition in glass forming systems. 
In glass science a great deal of efforts is devoted to understanding the dynam- 
ical properties of supercooled liquids. Relaxation and transport properties of 
such a state are subject to a dynamical crossover upon decreasing tempera- 
ture. There is an anomalous relaxation with heterogeneous patterns in space 
and time that are the signature of strongly cooperative effects. At a mean-field 
level, this crossover becomes a true phase transition. After a brief introduction 
on the phenomenology of glass forming systems, we will review the theoreti- 
cal perspectives on it, from thermodynamical to purely dynamical approaches. 
In particular I will expand on the spin facilitated model by Frederickson and 
Anderson. Within the framework of this model it is possible to recast the dy- 
namical jamming transition in terms of a bootstrap percolation scenario. Then, 
I will show how a certain degree of fixed heterogeneity, being it encoded as a 
simple dilution of the underlying lattice, or as a distribution in mobilities, can 
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dramatically change the collective behavior from bootstrap to simple percola- 
tion scenario. This can give insights on analogies and differences among the 
jamming of supercooled liquids and more heterogeneous systems, like polymer 
blends and confined fluids. 

2.1 Main experimental features of the glass tran- 
sition 

If we cool a liquid fast enough, it can avoid crystallization entering in a metastable, 
supercooled state [27]. The typical timescales of the relaxation and transport 
properties of such a state dramatically increase once we further cool it. Fis )2.1l 
shows the shear viscosity of some supercooled liquids as a function of the tem- 
perature, divided by the temperature at which it becomes of the order of 10 14 P. 
This temperature T g is called glass transition temperature and it is weakly de- 
pendent on the cooling rate. 




Figure 2.1: Viscosity as a function of reduced inverse temperature for three 
liquids: Si02, glycerol and o-terphenyl. For the o-terphenyl are also shown the 
typical time of reorientation of molecules. From [55] 

All these curves are fitted well by the Vogel-Fulcher-Tamann law (VFT) : 

fjoce 1 ^ (2.1) 

It is possible to distinguish strong and fragile behaviors. The former is consistent 
with Tk = 0, and A can have in this case the meaning of an energy activation 
barrier. The latter has a true divergence at > 0, and the typical energy scale 
to relax continuously increases upon decreasing temperature. 
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Near T g the typical timescale to relax at equilibrium exceeds the experimen- 
tal one and the system is practically out of equilibrium. 

In these range of temperatures there is a drop of the specific volume and of 
the specific heat towards the same value of the crystal (see fig !2.2|) . It is possible 
to calculate the entropy of the supercooled liquid and to extrapolate it below 
T g : at a certain point T' k its value equals that one of the crystal^. There are 




T 



T 



Figure 2.2: Top: a schematic plot of the temperature dependence of the spe- 
cific heat for a liquid. Avoiding the melting point doesn't change its fate: at a 
certain point (cooling-rate dependent) there is a drop towards a solid-like de- 
pendence. Bottom: The extrapolated entropy of a supercooled liquid below the 
glass transition point equals the entropy of the crystal 

strong empirical evidence in favour of the fact that Tfc = T' k [30]. Therefore 
Tfe should represent an infinite cooling rate limit of T gi where there should be 
concomitantly a thermodinamic singularity and a divergence of the relaxation 
time. Hence, is it possible to speak of the glass transition in terms of a truly 
thermodynamic phase transition? Unfortunatively, the density-density correla- 
tion function, or its fourier transform, the structure factoiQ, F(k) = ^2 i e lk ' ri ) 
doe not show any interesting change when decreasing the temperature. On the 



1 This quantity can be directly measured through scattering experiments. 
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other hand, the relaxation of its time-dependent version F(k,t), the interme- 
diate scattering function, shows very interesting features upon approaching T g 
from the supercooled phase, with heterogeneous patterns in space and time. 

Therefore, even if the static structure of the system doesn't show when 
decreasing the temperature any intereasting change, from the dynamical point 
of view, interesting phenomena are taking place. 

The relaxation of F(k,t) at low temperatures is indeed not exponential, 
rather it procedees by two step (see fi d2.3[) . First it approaches a plateau, the 
j3 relaxation, and then it departes from it towards the equilibrium value, the a 
relaxation. The height of the plateau starts discontinuously from a value larger 
than zero at a certain temperature. This is usually related to the miscroscopic 




ln(i) lag) 



Figure 2.3: A schematic plot of the relaxation in time of the intermediate scat- 
tering function. Left: high temperature, liquid phase, exponential relaxation. 
Right: at lowering temperature the function relaxes in two steps, first towards 
a plateau, the (3 step, and then, after a while, to zero, the a step. 

motion of the particles of the system. If we follow the average displacement in 
time (see fi d2.4j) of particles, at high temperature we a have a sharp crossover 
from a ballistic (d oc t) to a diffusive regime (d cx \/t). At low enough tempera- 
ture this two regimes are separated by a plateau. This means that a particle is 
trapped for a while by the cage formed by its neighbours, where it vibrates. A 
picture confirmed by numerics and experiments as well [31J. The motion within 
the cage is related to the /3 step, the rearrangment of the cages should be related 
with the a one. Finally, the a step itself is not exponential, being fitted by a 
stretched exponential formula exp - '*/ 1 "' 19 . This last trend is usually ascribed to 
a certain degree of dynamical heterogeneity: different parts of the same system 
can have different relaxation patterns, this causing in turn a deviation from the 
exponential. The microscopic resolution of the dynamics with numerical simu- 
lations has shown strong correlation patterns, like e.g. the clustering of more 
mobile particles (see |26j and ref therein). The fluctuations of the intermediate 
scattering function, i.e. the dynamical susceptibility, develops a maximum in 
time whose height increases upon decreasing the temperature. This maximum is 
related with the typical size of the correlated regions, thus defining a dynamical 
correlation lenght that diverges together with the relaxation time|26j. 
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Figure 2.4: Average displacement in time of particles by simulations of Lennard- 
Jones spheres for several temperature. Upon decreasing temperature, the divi- 
sion the between short-time ballistic regime and long-time diffusive one is given 
by a plateau. From [26] 



2.1.1 Other-than-molecular glass formers 

One interesting point, from a statistical mechanics perspective, is about the 
generality of such phenomenology. Interestingly enough, the same phenomenol- 
ogy, with a dramatic slowing down of the dynamics and complex patterns of 
relaxations in space and time, is shared by systems whose interacting units are 
of different scales from the molecular ones like colloidal suspensions, granular 
media and polymer solutions. 

Colloidal suspension[33] consist of big particles in a solvent, with typical 
sizes of 1 — 500 nm. The continuous scattering events with the much smaller 
particles of the solvent renders the dynamics of such particles brownian, with 
diffusion time of the order of 1 ms. They can be modeled as hard spheres, 
with an interaction potential that is infinite below a certain distance 2R and 
zero otherwise. In this case the temperature has the only role of rescaling 
times and what matters is the density p, or alternatively, the packing fraction 
$ = 4/37ri? 3 /3. At increasing $ the viscosity and/or the relaxation times of the 
system dramatically increases, and at $ ff ~ 0.58 the relaxation times exceed 
the experimental ones and the system is jammed. The system is now an elastic 
amorphous solid, the gel. All this remember the already seen phenomenology 
of the glass transition, and, in fact, it is found that a VFT formula is a good fit 
for the dependence of relaxation times on density, the dynamics of the correla- 
tion function has a two step relaxation and there is a certain degree of spatial 
dynamical heterogeneity. Another kind of systems that show jamming are gran- 
ular media [34]. They consist of large (N = 10 2 -10 6 ) assembly of macroscopic 
particles, from powder(10~ 5 m) to rocks (10 m). Because of their macroscopic 
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Figure 2.5: Left: spatial map of single particle displacements from simulations 
of a bidimensional Lennard-jones system. It is possible to recognize qualita- 
tively different mobilities and the presence of non trivial correlations in the 
motion. From [26] Right: The dynamical susceptibility develops a maximum in 
time whose height increases upon decreasing temperature, from simulations of 
a Lennard-Jones system in|32j 



scales, the thermal energy has no role and they have to be vibrated, sheared, 
etc, by an external source to explore the phase space. Therefore, there should 
be a continuous injection of energy that is continuously dissipated by friction, 
a force that play a key role in these systems. Their phenomenology is very rich. 
In particular, depending on the strength of the driving force, their properties 
can be seen as similar to that one of the usual phases of matter, with transition 
among them. That's why it is common to speak of granular gases, liquids and 
solids [35 . An interesting point comes up: when the grains are in the "solid" 
phase they are usually not arranged in a regular and/or crystalline structure. 
The solid is amorphous and the transition from the fluid phase is a dynamical 
arrest with a complex relaxation pattern, as can be seen e.g. in compaction- 
by- vibration experiments [36 . Interestingly enough, also polymer solutions have 
a jamming transition. When decreasing the temperature/increasing the den- 
sity, the dynamics of these systems is slowed down with a dramatic increase 
of the viscosity, till the system becomes an elastic solid, a gel [37 . There is 
clear dynamical crossover with the intermediate scattering function showing a 
stretched exponential decay. However, at odds with simple liquids, this sol/gel 
phase transition is well known. When decreasing the temperature/increasing 
the density, the polymers stick together, forming a network that at a certain 
point can span the whole system, a process that is called percolation. The study 
of such phenomenon opened the huge field of percolation theory, a kind of gen- 
eral and geometrical view on phase transitions 38 . In the simplest percolation 
scenario we have a lattice, whose bonds can be either empty or occupied with 
some probability p. At low p, the lattice is disconnected in clusters of finite 
size. Upon increasing p, at a certain point p c , there is a continuous transition 
by which one of the clusters span the whole lattice, that is now connected. The 
average clusters'size defines in this case naturally a correlation length[39]. It is 
interesting to notice that there are numerical evidences that this simple perco- 
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lation scenario for a dynamical arrest seems to be present even in super-cooled 
liquids once we confine them [40 . 

2.2 Theoretical views on the glass transition 

As we pointed out before, an intriguing qualitative difference in the dynamics of 
the supercooled liquid, that should give insights about mechanisms underlying 
the dramatic slowing down, is the anomalous two steps relaxation of correlation 
functions. A picture by Goldstein [41] tries to explain it in terms of a dynamics in 
the phase space ruled by activated processes. In a certain range of temperatures 
the energy landscape visited by the system is composed of many local minima. 
The dynamics should consist of vibrations within one minimum, the /3 step, and 
then jumps among minima, the a step. 

On the other hand, it is possible to write down equations for the correlation 
function, and by means of suitable approximations to solve them. This is the 
framework of the mode coupling theory (MCT) (42] , that gives many interesting 
insights and experimentally proved results for the high temperature regime of 
supercooled liquid [4"5]. It predicts quantitatively the features of the relaxation of 
correlation functions, with a two step relaxation, the development of a plateau 
in a discontinuous way and increasing fluctuations. But, at odds with the real 
liquid, at a certain point T c the correlation function sticks to that plateau. 
Hence, the main drawback of this theory is the wrong prediction of a singularity 
in the dynamics with a power law divergence of the relaxation time at T c > T g . 

Interestingly, the approximated equations of this theory are exactly the same 
of a mean-field model of spin glass: the p-spin spherical model[44]. Spin glasses 
are disordered materials whose magnetic properties show interesting behaviors 
that rensemble very close that ones of glasses. They are usually modeled by 
classical spins on lattice, whose interactions can be both antifcrromagnetic and 
ferromagnetic. These model systems are characterized by the phenomenon of 
frustration. It is impossible or extremely hard to satisfy all the interaction terms 
in the Hamiltonian, and this gives rise to a very complex energy landscape, full 
of minima and saddles. This is often a distinctive feature of complex systems 
in general, and concepts and methods used for spin glasses are currently used 
in fields as different as biology (neural networks) and information theory (algo- 
rithmic complexity) 145^ . In the p-spin spherical model N continuous spins <7i 
interact by p-body terms, the hamiltonian being: 

H = - E Jii,..,ip<rii—<rtp ( 2 - 2 ) 

ii,...,i p 

where the J are quenchecd random variables with a gaussian probability dis- 
tribution of zero mean, and the spins are subject to the spherical constraint 

2 The interaction terms are slowly changing with respect to the spin variables, i.e. they are 
fixed once for all. In the thermodynamic limit, the average over all the possible configurations 
of interactions of extensive quantities, like the free energy, should give the same result of a 
given single instance. 
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J2i °f = N. Most of these model systems in general, and the p-spin model in 
particular, are subject, upon lowering T, to a dynamical phase transition and 
moreover they have a truly thermodynamic singularity, the replica simmetry 
breaking phase transition^. The first, corresponding exactly to the singularity 
of the MCT, it is an extreme case of the already mentioned Goldstein scenario. 
The dynamics is ruled by activated processes, i.e jumps among local minima of 
the energy, whose number is exponential in the system size. This crossover be- 
comes a truly phase transition because, at mean field level, the barriers among 
minima are infinite in the thermodynamic limit. The second is static and it is 
characterized by ergodicity breaking. 

The phenomenology of the p-spin model seems to give a good metaphor for 
the dynamics in phase space of structural glasses. Therefore, it has recently 
inspired replica-based approaches for Lennard- Jones fluids[46 and hard-sphere 
systems [47] 0. However spin glasses are different from structural glasses, the 
main difference being the presence of quenched disorder. 

An alternative approach is to look at glassiness from a pure dynamical per- 
spective, without recurring to a complex energy landscape scenario. This ap- 
proach is based to the study of lattice models with simple hamiltonian and 
trivial equilibrium behavior, but whose dynamics is subjected to some kinetic 
constraints, such that they can show glassy relaxation patterns |48j. These mod- 
els can give deep and useful insights about the miscroscopic mechanisms of the 
first step of the glass transition, the dynamical crossover. It should not be 
forgotten that the equilibrium dynamical properties of the supercooled system 
around this crossover are accessible to experiments. Below it, the experimental 
investigation of the thermodynamic properties requires excedeengly large times. 
In particular, within their framework the question of how the underlying spatial 
topology affects the dynamics can be directly addressed and easily analized, as 
we shall see soon for a particular case. 

2.2.1 The Prederickson- Andersen model 

One of the first kinetically constrained model was introduced by Frederick- 
son and Andersen (FA) 49 . On top of each site i of a lattice there is a clas- 
sical 1/2 Ising spin Sj that can be 1 or —1. The spins are uncoupled and 
there is a global magnetic field of strenght 1 pointing up, the Hamiltonian 
being simply H = — J^. Sj. The static properties are very simple and the sta- 
tionary probability distribution function of the spin configurations factorizes 
P(si, ...,Sjv) = TiiPi( s i)- The dynamics is characterized by an additional con- 
straint: a spin can flip if at least / of its neighbours are down. Down spins 
should represent region with high mobility such that they trigger the relaxation 
of their neighbours. This rule doesn't violate detailed balance but it can trigger 
a dynamical arrest. Upon decreasing the temperature, at a certain point, the 

3 A replica is a copy of the system with exactly the same realization of quenched disorder, 
if any. Actually replicas were first introduced as a trick for calculations. 

4 However, in finite dimension the scenario is even more complex: different parts of the 
same system could be in different minima, with a characteristic size £ for these domains 
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system cannot relax because a finite fraction of the spins doesn't flip anymore, 
i.e. they are frozen. A good parameter to characterize this transition is thus 
the fraction of blocked spins $ as a function of the temperature. 

It is possible to analize this model at a mean field level onto a bethe lattice of 
degree z [50] . This lattice can be seen as the infinite size limit of a Cayley tree, 
i.e. the graph obtained starting to branch from a seed node with a constant 
branching k = z — 1, or of a random regular graph, i.e. a graph taken from the 
ensemble of all the graphs whose nodes have degree z, all with equal statistical 
weight. The first is a tree but it has strong boundary effects, the second is locally 
a tree, having loops whose lenght scales with the logarithm of the system size. 

Let us call B = P(A) the probability of the event A: the spin at the end of 
a random link is in the state —1, or it can flip to this state by rearranging the 
k sites above it. B verifies the iterative equation: 

k - f <u 



B=(l-p)+pY,[ l )B k - t (l-By (2.3) 

where p = 1+e \ 1/T is the probability that the spin is +1 at equilibrium. The 
term 1 — p on the rhs is the probability that the spin is already in the state 
— 1. The other term is the probability that the spin is in the state +1 (p) and 
that it can flip by rearranging the neighbours (the sum). The sum is thus the 
probability that the event A is not verified for at most k — f out of k neighbours, 
i.e. that A is verified at least for / of them, that is, the constraint is satisfied. 
There is always a solution B = 1. For / = 1 it is the only solution. For / > 1, 
the so-called cooperative cases, we can have a fixed point B < 1. We define 
x = 1 — B that verifies the equation: 

i=0 w 

The parameter that distinguish jammed from free phases is the fraction of spins 
permanently frozen $: 

/-a 

/-i /-i 
$ = P J2 x k+1 ^(l - x)* + (1 - p) J2(ph) k+1 - l (l - ph) 1 (2.6) 

i=0 i=0 

The two contributions arc the probability that a spin is frozen in the +1 or —1 
state, respectively. 

Let's analize the case / = 2, k = 3. We have the trivial solution x = 
and 1 = px{i — 2x). The critical value at which the transition takes place is 
p c = 8/9, or T c ~ 0.48, where $ jumps discontinuosly from to $ c ~ 0.67, 
such that $ — $ c ~ (T c — T) 1 / 2 . The dynamics of relaxation at equilibrium is 
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analized in terms of the persistence function <f>(t), i.e. the fraction of spins that 
do not flip till time t. This is a measure of the self correlation of the system and 
lim t _ s . 00 (f)(t) — $. Looking at the temporal trends of <fi in fig |2.6[ left, we can 
see how effectively, it has an exponential behavior at high T, then it deviates 
from it, starting to develop a plateau upon lowering T, till T c , where it sticks to 
the plateau concident with the value of The integral of 4> gives an estimate 
of the typical relaxation time, that diverges at T c with exponent 7 ~ 3 (see fig., 
right). 



■e- 




-2-1fl1Z345S7a -3-2-10123*58 

Figure 2.6: left: Time trends of the persistence function 4>(t). Upon decreading 
temperature, it has a two step relaxation, developing a plateau in a discon- 
tinuous way. The straight line is calculated analitically. Right: Power law 
divergence of the integral relaxation time as a function of the temperature at 
T c . Simulations from [50 j 



The fluctuations of <f>(t) show critical behavior upon approaching the T c . Fig 
12. 71 shows the dynamical susceptibility x{t) — N(((f)(t) 2 ) — (<j)(t)) 2 ) that develops 
a maximum whose height is diverging at T c . 

This dynamical phase transition is thus called hibrid, because the parameter 
$ jumps discontinuously at the transition point to a finite value, but it has 
critical fluctuations and a well defined exponent for the value of $ — <!> c upon 
approaching the T c . 

Even if an exact mapping is still missing, this jamming scenario is in very 
good agreement with the dynamical phase transition of the simplest MCT and 
of the p-spin spherical model. 

The bootstrap percolation problem 

The FA model can be mapped onto the bootstrap percolation (BP) [FT] problem. 
In BP, each site is first occupied with a particle with probability p, then, particles 
with less then m neighbouring particles are removed. Iterating the procedure, 
we can end up with a remaing m-cluster of particles or not, depending on p, 
the initial density. This model can be analized exactly on a Bcthe lattice of 
degree z. We let R be the probability that an occupied site i is not connected 
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Figure 2.7: Time trends of the dynamical suscieptibility. A maximum is de- 
veloping, whose height increases at decreasing temperature. Simulations from 



to an infinite m-cluster containing its nearest neighbor j. It can be so if j is not 
occupied (w.p. 1 — p) or if less than m — 1 of the other neighbors of j are also 
not in the m-cluster. Thus we find that: 

m_2 / — 1\ 

R = 1-P + P J2 r ■ )R k -*(l-Ry (2.7) 

And this is the same equation of B if 

m = z - f + 1 (2.8) 

There is always a solution R = 1. Depending on p we can have a fixed point 
R < 1. The case m — 2 has the same equation of the ordinary percolation 
problem [3S]. The remaining cluster in the m = 1 case is the same of m = 2 
case with the adjoint of dangling bonds, i.e. the chain structures connected 
to the 2-cluster. Below the transition point of the m = - 2 case, in the m = 1 
case, there are still remaining clusters, but they are disconnected chains whose 
relative size decreases to zero in the thermodynamic limit. The fraction of sites 
in the m-cluster, or the probability that a site is part of it, P m , has the form: 

P m =pJ2( ) Ri ( 1 - R Y~ i (2-9) 

i=0 

These equations can be solved along the same lines of the FA model. Fig l2.8l 
shows the transition curves P m {p) for a bethe lattice with connectivity z = 6. 
We have a continuous transition P m cx (p — p c )P for m = 1, 2 with exponents 
j3 = 1,2 respectively. For m > 2 the transition is discontinuous P m — P mc oc 
(p — p c )@ with exponent (3 = 1/2. 
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Figure 2.8: Relative size of the BP m-cluster as a function of the density P m (p), 
for several m for a bethe lattice of degree z — 6. 

2.3 The heterogeneous FA model 

As we have seen, it is possible on a random regular graph to recast the jamming 
in the FA as a bootstrap percolation transition. In particular, depending on the 
facilitation parameter / of the model, and on the degree z of the underlying 
lattice, it is possible to have a bootstrap or a simple percolation scenario, if 
m = z — f + 1 is larger or not than 2 respectively. It is possible to consider 
situations in which m is varying from site to site, i.e. considering different 
degrees and/or facilitation parameters [35]. Let us consider a diluted version 
of the previously analized lattice, i.e. a trimodal random graph with degree 
distribution P(k) = uSk.2 + (qi — u)Sk.3 + (1 — qi)Sk,i, the average degree is 
z = 4 — qx — u. Let us[53 put on top of such a lattice the FA model with 
facilitation parameter / = 2 [53] . We can extend the equation 12.31 to general 
heterogeneous random graphs considering the probability Bk that a spin verifies 
A and it has k + 1 neighbours, 




i=0 



(2.10) 



And B = X)fc ( fc+1 )-^( fc+1 ) Bk is the average of Bk over the degrees, that verifies 
the equation: 




5 On a random graph with degree distribution P(fc), the degree distribution of a random 
neighbouring node is P(k)k/z 
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or, in terms of x = 1 — B: 

^ (k + l)P(k + l) ^ fk\ k _ iM si , 010 , 

k i=0 ^ ' 

The equations for / = k + 1 and f = k are the same, and they are the same 
of ordinary percolation. We have, finally (apart of the x = solution): 

- = a(2 - x) + (1 - a)x(3 - 2x) (2.13) 
P 

where a = 3<il1 ~ u . Then we have: 



3 - 4a + ,/9 - 8a - 

Id-.) " (2 ' 14 > 

This solution exists if p > p c \ — §E§§, and, if a > a c — 3/4, it is positive 
until p > p C 2 = Below a c , we can expand around p c i, p = p c \ + e, we have 

x~A 1 +A 2 Vt (2.15) 



where A\ = , 3 n ia , and A 2 = ^ °l ■ The transition is discontinues with 

1 4(l-a) z 2p c i(l-o) 

exponent 1/2 and x c = A\ at the critical point. Above a c , expanding around 
Pci we end up with 

x~A 3 e (2.16) 

where A 3 = 4 4a 3a , a continuos transition with exponent 1. The crossover is at 
the point a c = 3/4, p c = 2/3. 

The fraction of blocked spins $ has the general form: 

oo /-I /, \ oo /-I /t\ 

<£= P J2 p ( k ) E J ^"'a - + (! - p) E p ( fc ) E J ^"'a - h y 

k j=0 ^ ' k i=0 ^ ' 

(2.17) 

where 

^ (fc + l)P(fc + l) t. 2 fk\ k _. . 

h = P2^- -r "E L- ) x ( l ~ x ) ( 2 - 18 ) 



fe 

that, in our case it is: 



^^ + 3(^-^ + 4(1-^ 
4 — qi — u 



$ = p(ux(2 -x) + (ql - u)x 2 (3 - 2x) + (1 - ol)a; 3 (4 - 3a;)) 
+(1 - p)(uh(2 - ft) + (ql - u)h 2 {i - 2ft) + (1 - ql)ft 3 (4 - 3ft)) (2.20) 
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Figure 2.9: Phase diagram of the system in the (a,p) plane, at C = (3/4,2/3) 
the transition changes character 



Below a c we have 

3>^2p c u{l+ 2 } l -? c)u )A % e (2.21) 
4 — ql — u 

If u = 0, the leading order in the e expansion is 2 (see the right part of fig |2.10[) : 
Above a c , we have instead: 

$ - $(x c ) oc Ve (2-22) 
In synthesis, the picture is as follows: 

• If a < 3/4, above p c \ = §E§f there is a discontinuous jamming transition 
with exponent 1/2 

• If a > 3/4, above p C 2 — 4^ there is a continuous transition with exponent 
1 

We will consider from now on three lines in the phase diagram, fig l2.9l qu — 
0.25, that can be considered a perturbation with respect to a random regular 
graph; q±2 = 0.7, where the transition is still discontinuous but closer to the 
point C, and 1713 = 0.85, in the region with continuous transition. Fig ]2.10l 
shows the transition curves <&(T) along these three lines. We have, respectively, 
the critical temperatures T x = 0.5386, T 2 = 0.9362 and T 3 = 2.0843. 

Fig |2.11l shows the persistence <fi(t), i.e. the fraction of spins that do not 
flip until time t, by simulations. Upon decreasing T, the system starts to relax 
in a non-exponential way and then, it falls out of equilibrium, developing a 
plateau in the persistence, i.e the fraction of blocked spins </>(oo) = $. As 
predicted from analitics, the plateau starts to develop discontinuosly and/or 
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Figure 2.10: Left: Transition curves $(T) for q x = 0.25,0.7,0.85 , u = 0.001 
Right: Inserting a small fraction of nodes with degree 2 the transition exponent 
changes from 2 to 1 {q\ = 0.85). 



continuosly from the transition point, depending on the connectivity of the 
underlying graph (controlled by q x ). Nearby the transition temperature T c , we 
can verify that there is a scaling law for the persistence of the type <f)(t, T) — 
4>(t/T(T)), where r is the integral time, i.e. simply the integral over time of 
the <f>. This anomalous relaxation can be solved microscopically, looking at 
the distribution of persistence times P(r), i.e. the time for the first spin- flip 
to occur. In fig l2.12l we can see that for both qi = 0.25,0.7, when decreasing 
the temperature, the distribution starts to develop another peak, instead, for 
qi = 0.85, when decreasing T, the distribution starts to develop a fat tail. Then, 
the dependence on temperature of typical relaxation times t(T), calculated 
as the average of the distribution is in a good agreement with a power law 




Figure 2.11: Top: persistence curves <j>(t) for q x = 0.25,0.7,0.85 (it = 0.001), 
respectively from left to right, for several temperatures. Simulations for a graph 
of size N = 5 ■ 10 4 , averages over 10 realizations, plateaus from analitical results. 
Bottom: Rescaled persistence curves 
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Figure 2.12: Top: distribution of persistence times P{r) for q\ ~ 0.25,0.7,0.85 
(u = 0.001), respectively from left to right, for several temperatures. Simula- 
tions on top of a graph of size N — 2.5- 10 5 . Bottom: Average persistence times 
r(T) 



divergence at the critical temperature r(T) ~ (T— T c )~ 7 , where 7 depends on q\. 
Finally, we investigate the dynamical susceptibility x 2 (t) — N((<fi(t) — (<fr(t))) 2 ) 
(see fig |2.13|) . This increases with time until it develops a maximum and/or 
a plateau, respectively for discontinuous and/or continuous transitions, whose 
height increases and diverges upon approaching T c However, it should be said 




Figure 2.13: Dynamical susceptibility x 2 (0 for qi = 0.25,0.7,0.85 (u = 0.001), 
respectively from left to right, for several temperatures. Simulations on top of 
a graph of size N = 10 4 , averages over 100 realizations 



that the divergence of relaxation time in the continuous case needs further 
investigations. 

Facilitated spin mixtures on homogeneous graph 

An interesting point is that it is possible to obtain exactly the same results con- 
sidering an homogeneous lattice and varying facilitation parameter from node 
to node. Lets' consider the FA model with a trimodal / = 2, 3, 4 distribution of 
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facilitation parameter in a bethe lattice with degree z = 4, respectively a spin 
can have / = 2 with probability 1 — q, f = 3 w.p. q — r and / = 4 w.p. r The 
self-consistent equation for i?, the probability that, following a link, a spin is 
up, or can be in the next steps moving the other spins on the top, is: 

B = (1 - p) +p(B 3 + 3(1 - g)(l - B)B 2 ) (2.23) 
We have for x = 1 — B 7 apart from the x — solution: 



= 3(i-2 g ) + v /y-8p + r2 g p(i-^) 

2p(2-3 9 ) 1 ' ' 

This solution exists, for q < q c = 1/2, if p > p c i = g7§|E§] ; and, if q > q c = 
1/2, it is positive until p > p C 2 — j^. Below q c , we can expand around p&, 
P = Pel + e, we have 

x~A 1 +A 2y ^ (2.25) 

where A\ = and A 2 = ^^^ql^ r^- ■ The transition is discontinues with 

exponent 1/2 and x c = A\ at the critical point. Above a c , expanding around 
Pel we end up with 

x ~ A 3 e (2.26) 

o 2 

where A 3 = j^^, a continuos transition with exponent 1. The crossover is at 
the point q c = 1/2, p c = 2/3. 

The fraction of blocked spins is: 

4> = p(x i {A - 3x) + 6qx 2 {l - xf + Arx(l - x) 3 ) + 
(1 - P ){h 3 (4 - 3/i) + 6qh 2 (l - hf + Arh(l - h) 3 ) (2.27) 

where 

h = p(x 3 + 3(1 - q)x 2 {\ - x) + 3rx(l - x) 2 ) (2.28) 
and x is the solution that we have discussed. Below q c we have 

0~4p c r(l + 3r(l-p c ))A 3£ (2.29) 

Above a c , we have instead: 

<j) - <j>(x c ) cx 41 (2.30) 
In synthesis, the picture is as follows: 

• If q < 1/2, above = fp|E§] there is a discontinuous jamming transition 
with exponent 1/2 

• If q > 1/2, above p C 2 = ^ there is a continuous transition with exponent 
1 q 
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Figure 2.14: Phase diagram of the system in the (q,p) plane, at (1/2, 2/3) there 
is a critical point 



2.3.1 Conclusions 

In the cooperative case, the Frederickson-Andersen model can give a good 
mean-field microscopic description of the anomalous relaxation and dynami- 
cal crossover of glass forming liquids in the range of temperature slightly above 
the crossover point. The relaxation of correlation functions proceedes by two 
steps, the height of the plateau starting discontinuosly from a finite value. The 
dynamical susceptibility grows in time till it reaches a maximum whose height 
increases upon decreasing the temperature. At odds of real liquids and similarly 
to the MCT there is a power law singularity at T c , where the system starts to be 
jammed. Microscopically this correspond to a bootstrap percolation transition. 

I showed that this same model can change character on a diluted, heteroge- 
neous structures. For high enough dilution the transition becomes continuous, 
within the class of simple percolation. There are not two steps in the relaxation, 
that still shows stretched exponential dependence upon approaching the critical 
point. The dynamical susceptibility develops a plateau whose height is slowly 
increasing when approaching the singularity. 

This simple percolation dynamical arrest scenario is known to be the one of 
the sol/gel transition in polymer blends, and recent numerical simulation studies 
shown that it is valid also for strongly confined fluids. 

It seems that the simple ingredient of a fixed heterogeneity, being enconded 
in the spatial structure or in the mobilities, can change qualitatively a dynamical 
arrest scenario, dividing systems in two classes from this point of view. 

However, more detailed numerical investigations of this model in the contin- 
uous regime are needed, but it should be important to test the universality of 
such a mechanism applying it to other kinetically constrained models, like the 
one by Kob-Andersen[54] or others [55]. 



Chapter 3 



Inverse phase transitions on 
heterogeneous graphs 

The relationship between model systems and the underlying topology is at the 
core of research in statistical mechanics. It is a common belief that the dis- 
tinctive equilibrium features of simple model systems are affected only by the 
internal symmetries and by the dimensionality of the space. In this chapter it 
is shown that a certain degree of heterogeneity in the underlying structure of 
network of interactions can trigger inverse phase transitions in tricritical model 
systems. 

Inverse phase transitions are stricking phenomena in which an apparently 
more ordered phase becomes disordered by cooling. In the first paragraph there 
is a basic introduction to such phenomenon, with a special focus on inverse 
melting because of its relationship with some fundamental problems in statistical 
physics [56 . Then, there is a discussion about the simplest model system that 
shows inverse melting, i.e. the Blumc-Capel model with higher degeneracy 
of interacting states [57; . Finally, I will show how inverse melting can emerge 
spontaneusly in tricritical model systems if the underlying graph has certain 
features, i.e. if sparse subgraphs are crucial for its connectivity. I will work 
out many results[7_0] for the simple Blume-Capel model, and I will give some 
insights that the random field Ising model shares the same phenomenology. 

3.1 Experimental inverse transitions 

Inverse transitions in their most generic meaning have been detected in a num- 
ber of different materials and between phases of different nature (see [57] and 
|58j for a review). The first experimentally seen inverse phase transition re- 
gards the miscibility properties of liquid mixtures[59 a . Fig 13. If left) shows the 
loop-shaped phase diagram of the solution Nicotine+^O. A reentrant phe- 
nomenon is evident. The solution is mixed at an high temperature, it demixes 
by cooling and it gets mixed again by further cooling. Many different multicom- 
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Figure 3.1: Left: experimental sketch of the looped miscibility phase diagram 
(T, c) of the solution Nicotine+^O. From[51|]. Right: sketch of the general 
miscibility phase diagram of a binary solution including the strenght of hydrogen 
bonds between unlike molecules as a third axis. 



ponent solutions show this behavior |58). The mechanism behind it relies on the 
strong directionality of hydrogen bonds between unlike molecules [60] . In the 
low temperature mixed phase, when unlike molecules interact, they form some 
complexes with a well defined orientation, thus freezing their internal rotational 
degrees of freedom. This in turn has the effect of lowering the total entropy 
with respect to the demixed phase. Therefore in this case demixing is basically 
an entropy driven process and the demixed phase is counter-intuitively more 
disordered. 

At the beginning of the last century [52] speculations were put forward about 
the possibility of an inverse melting: a crystal that liquifies by cooling. This 
is confirmed nowadays experimentally on many substances, the most famous 
examples being the inverse melting of He^ and He^ at high pressures 55]. The 
interesting point is that in this case the standard ratio of the entropies of the 
solid and liquid phases is inverted, the solid being more disordered. In particular, 
at the point at which the inverse behavior starts, the entropies of the two phases 
are equal. This is a practical realization of the Kauzmann scenario 56 that I 
sketched in the second chapter. The specific heat of many substances in the 
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supercooled liquid phase is usually higher than the one of their crystalline phase. 
The decrease by cooling of the entropy of the supercooled liquid is steeper than 
the one of the crystal. Extrapolating it below the point at which the system gets 
out-of-equilibrium, the glass transition point, there should be a temperature at 
which they are equal. It should be possible that the liquid below this point 
has a lower entropy. This was seen as a paradox because it was believed that 
the ground state of a physical system made of identical objects should be a 
crystal. Many mechanisms were proposed to avoid this and some of them are 
at the core of theoretical views on the glass transition. However, the existence 
of inverse melting shows that in general this is not a paradox. It is true that 
a crystal can have an higher entropy than a less interacting phase. This can 
be explicitly pointed out in the polymer melts. A polymer can be in many 
microscopic configurations. The ground state is often unique, non-interacting 
and looped(see fie f3.2|) . Thermal noise can unfold this structure, making the 
polymers interacting. All toghether they can form networks, i.e. a solid phase. 
A very well known case is the inverse melting of the crystal polymer made by 
the isotactic poly(4-methylpentene-l), P4MP1 (see 5 eI3.2|B3~] ). 



Figure 3.2: Left: Sketch of the energy and entropy of a polymer chain as a 
function of the lenght. Right: Sketch of the melting curve in the (T,p) plane 
for the polymer P4MP1.[63] 



3.2 A simple model for inverse phase transition 

Many mathematical models were proposed to explain how a phase transition 
can be inverted (see [ST] and [5T] for a review). In almost all of them the most 
interacting configuration of the units that made the system has by construction 
an higher degeneracy. The simplest model that can encode this feature is the 
Blume-Capel model. At first proposed to explain the occurrence of a first order 
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magnetic transition in the [/O2EM], it became the representative of tricritical 
systems. It consists of N ferromagnetic interacting 1-spins Sj = ±1,0 that have 
a cost in energy to be present, i.e a chemical potential A, the hamiltonian being: 

H = -^s iSj +Aj24 (3-1) 

Where the first sum is over the bonds of a given lattice. Inspired by the already 
seen phenomenology of inverse transition in polymer melts we can think of the 
interacting phase as having more degeneracy than the non-interacting one|57j. 
That is, we imposed by hand that the states with Si = ±1 are r > 1 times more 
present of the ones with Sj = 0. We can recur to a mean field approximation, i.e. 
no spatial structure, by which every couple of spin is interacting. We rescale the 
interaction by 2N. Using standard gaussian integral techniques it is possible to 
find the expression of the free energy: 

Pf = - log(l + 2r cosh(^m)e- 2 ' 3A ) (3.2) 

Where m is the order parameter, the average magnetization, that can be found 
by minimizing /. This requires to solve the self consistent equation: 

_ 2rsinh(f3m) 
m e? A + 2rcosh(f3m) [ ' 

There is always a solution m = 0. We can expand in powers of m: 

m = Am + Bm 3 + ... (3.4) 

When A = 1, another solution starts to occur, i.e. when 

= 1 + ^ A (3.5) 
Zr 

And the solution m — becomes unstable, i.e. a maximum for /. The equation 
13.51 defines thus consistently a curve of second order, continuous critical points, 
till B < 0. When B changes sign, at T c — |, A c = log4T c there is a tricritical 
point, after which the transition becomes discontinuous. However, the ea l3.5l 
after this point continues to be the line of stability of the m = solution, i.e. the 
spinodal curve of the paramagnets. It is possible to study numerically the stabil- 
ity of the other solution, thus definying the spinodal curve of the ferromagnetic 
solution. In the region between the two spinodal curves both the paramagnetic 
and ferromagnetic solutions are minima of the free energy. The transition is 
thus characterized by coexistence and hysteresis phenomena in this region. It is 
possible to compare the free energies of both solutions to characterize which one 
is stable (absolute minimum). In particular the Clasusius-Clapeyron equation 
is valid along the equilibrium curve : 
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Where S is the entropy, p — (s 2 ), and the labels m, p refers to the ferromagnetic 
and paramgnatic phase respectively. This equation shows that ^ > implies 
S m > S p . In fi s!3.3l the phase diagram in the (A,T) plane is shown for r = 6. 
There it is possible to see clearly the emergence of a reentrant phenomenon with 
respect to the normal case (r = 1, in the inset) Inverse phase transitions can 




Figure 3.3: Phase diagram of the Blume-Capel model in the (A, T) plane with 
higher degeneracy of the interaction state r = 6. Inset: the same for the normal 
case r = 1. 



emerge also spontaneously in tricritical model sytems, without the assumption 
of an higher degeneracy of the interacting states. For instance, the spin glass 
version of the Blume Capel model, with ferromagnetic and antiferromagnetic 
couplings, shows inverse freezing [66] between glassy and fluid phases. 

I will show in the next paragraph that inverse phase transitions can emerge 
spontaneously also in the normal, ferromagnetic, Blume-Capel model on het- 
erogeneous structures. 



3.3 Topology- induced inverse phase transition 

Let's consider the Blume-Capel model now on a general heterogeneous graphs[70 . 
For random graphs of given degree distribution P(k) it is possible to set up 
the following approximation scheme (Curie- Weiss). We consider the following 
Hamiltonian function: 

H = -^E^V^i + A£> 2 (3.7) 

Where the hi are independently identically distributed quenched random vari- 
ables according to the distribution P(k). This is equivalent to consider the 
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model on a fully connected geometry with link weights ay = -h^-- The calcu- 
lation follows along the lines sketched in the previous paragraph. Finally, we 
come up with self consistent equations for m, m„, i.e. respectively the aver- 
age magnetization of a randomly chosen node and that one of a node reached 
following a randomly chosen link: 



fcP(fc) 

k 



2sinh((3km v ) 



z ef A + 2cosh(f3km v ) 

2sinh{f3km v ) 
eP A + 2cosh(f3km v ) 



(3.8) 
(3.9) 



Where z is the average degree. The continuous critical line depends on the ratio 
between (fc 2 ) and z: 







(k 2 



1 



1 



,/3A 



(3.10) 



Then, at T c = 4-^-^, A c = log4T c there is the tricritical point, after which the 



transition becomes discontinuous. We can define rescaled variables S 



T = T 



such that the A-line collapses on a master function: 
5 = rlog[2(l/r-l)] 



W)' 



(3.11) 



After the tricritical point, the line of first order phase transitions shows a strik- 
ing difference between the homogenenous and heterogeneous case, with the ap- 
pearence of a reentrant phenomenon in the latter. 



0.6- 



- P(k)~k"' y>3 
■ - Homogeneous 



Disordered 



0.3- 




Ordered 



Figure 3.4: Phase diagram (5, r) of the Blume-Capel model within the Curie- 
Weiss approximation. The first order branch can be reentrant for heterogeneous 
networks 



However, this approximation is not exact. But given the tree-like nature of 
random graphs it is possible to se up a better approximation (Bethe-Peierls). 
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In fact, we can write the partition function in a recursive way. Let's select 
one node and write the partition function as a function of the ones of the sub- 
branches from that node. The approximation relies in the factorised form, that 
is, independent sub-branches (no loops). 

% = J2 e ~ m4 II ^(so) (3.12) 
so jeN 

^•(*i)=£ e/3(S<Si ~ AS?) II 9ik(sj) (3-13) 

writing gij(si) = Aije^^ UijSi ~ Vii!>i \ we can solve for the Uij, Vij from the equa- 
tions 



k^i 

y = A + v jk 

k^i 

(1 + e-^coshjPjx + !)))(! + e-to2cosh(P(x - 1))) 
~ 2 ^= l °9 1 + e-to2co8h(f)x) (3 ' 14) 

2 ^ = ' og TT^w^ (3 ' 15) 

and get the magnetization per node 

2sinh{(3 J2i «0i) 



(3.16) 



These equations can be solved for specific instance^. Fig l3.5l shows for an 
heterogeneous random graph the transition curves m(T) and the phase diagram 
as well, from both simulations and BP approximation scheme. The agreement 
is very good and the picture sketched previously by the CW is correct. A 
certain degree of heterogeneity for the graph can be responsible for reentrant 
phenomena and inverse phase transition in this model. 

Is it possible to better characterize this "certain degree of heterogeneity"? 
Fiij }3.5l also shows how a change in the exponent of the degree distribution can 
suppress this inverse phase transition. 

Once again we can turn to the CW approach to get useful insights. The 
zero-temperature self consistent equation takes the form 

m v = V -P(k)d(km v - A) (3.17) 
'-^ z 

k 



1 At low temperatures is convenient to observe that Tlog(l + 2cosh(j3x)e @ y ) — ► f(x,y), 
where f(x,y) = if \x\ < y, f(x,y) = \x\ — y otherwise 
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Figure 3.5: Inverse phase transition and reentrant phenomena in a heteoroge- 
neous random graph of size ./V = 10 4 , with degree distribution P(k) oc fc~ 7 , 
7 = 3.2 and k m i n = 2. Left: Transition curves m{T). For large enough A 
there is a reentrant phase transition, that is dumped for a different exponent 
7 = 2.5. Right: Phase diagram. From Monte carlo simulations(points) and BP 
numerical calculations (lines). 



It is interesting to observe that in this approximation there is a degree k* = -A- 
such that nodes with connectivity k > k* have m,f. — 1, while for the others 
TOfc = 0. The fact that nodes with different connectivities can be in different 
phases can be easily checked for a bimodal random graph. Fig |3.6l shows the 
transition curves m(T) at A = 3 of the components of a bimodal random graph 
with connectivity distribution P(k) = 0.2Skio + 0.8<5fc2- The nodes with degree 
2 show a reentrant phase transition, while the high degree nodes go to a value 
slighty less then 1 at zero temperature. 

This suggests that the reentrant phenomenon can be ascribed to a mecha- 
nisms by which low degree nodes are "turned off" at low temperature because 
they are frozen in the s, = state by the effect of the chemical potential A. 
This in turn can lower the connectivity of their neighbours, with a cascade ef- 
fect that can disconnect some parts of the graph. For nodes of degree 2 this 
argument can be worked out rigorously. The effective interaction transmitted 
by a node of degree 2 between its ends depends on the temperature and it can 
be calculated with the use of the simplest renormalization group scheme: 

2(3J eff = log( 1 + 2e . pA K ^ ) (3.18) 

Fig 13.71 shows its non-monotonous behavior for A > 2. 

This argument suggests that also the role of degree-degree correlations of 
the graph can be crucial for the collective behavior of such model system. The 
degree correlations of a network can be quantified by the assortativity: 

(fcfc'>i-<(* + */)/2>? 



{{k 2 + k >2 )/ 2} l -((k + k>)/2}S 



Where (); denotes an average over the links, and (k,k') denotes the degree of 
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Figure 3.6: Transition curves rn{T) for the different components of a bimodal 
random graph. From Monte carlo simulations (points) and BP numerical calcu- 
lations (lines). 



the nodes at either end of links. 

It is possible to obtain a graph with a given degree distribution and assor- 
tativity r along the lines of the following exponential random graph model [65]. 
Let's Suppose that we want to construct a network model specified by an ob- 
servable x. We can think of an ensemble in which the probabilistic weight of 
a given network G is P{G) oc e - H{G \ where H(G) = 8x{G) and 6 should be 
such that x is equal to the desired value. Then a suitable monte-carlo scheme 
has to be adopted to sample the network ensemble. In our case x = r and 
H = kikj, if the degree distribution is fixed. We can think of the 

following mixing procedure (see fi e>3.8[) . Two links are randomly drawn (a, b) 
and (c, d) and are sobstituted by the new links (a, c) and (6, d) with probability 
P = min{l, exp(—9(k a — kd)(k c — ki,)}. This update rule verifies the detailed 
balance and doesn't change the degree of the nodes. The effects of this procedure 
are shown graphically in 13.81 for a small network. 

Fig l3.9l shows the transition curves m(T) at A = 3 of the different com- 
ponents of the previous bimodal graph after this mixing procedure (9 = — 1, 
disassortative mixing). This time the fact that the low degree nodes are turned 
off at decreasing temperature is enough to disconnect the whole graph of in- 
teractions, tuning a reentrant phase transition. This mechanism for reentrance 
based on the freezing of sparse subgraphs can give an explanation of the different 
behaviors observed in the left part of fig l3.5l It is the case that random graphs 
with a power law degree distribution have qualitatively different structures if 
the value of the exponent 7 is above or below 3. In fact, the number of short 
loops in a network with 7 < 3 is big. These networks are more clustered and 
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Figure 3.7: Effective interaction J e ff(T) between the ends of a node of connec- 
tivity 2 as a function of the temperature for several A. 




Figure 3.8: Left: a sketch of the rewiring procedure. Right: Its application onto 
a network of 100 nodes, a is disassortative (9 = —1), b uncorrelated and c is 
assortative (9 — 1). From [55] . 



sparse subgraphs should not be crucial for their connectivity, as it should be the 
case if 7 > 3 [57]. 



3.4 Conclusions 

In this chapter I showed how an inverse phase transition can emerge sponta- 
neously in the Blume-Capel without recurring to an higher degeneracy of the 
interacting state. I showed a mechanism that trigger this phenomenon, based 
on the freezing of sparse subgraphs. If they are crucial for the connectivity, the 
overall graph of interactions can be disconnected by cooling. It should be the 
case that this picture is correct in general for tricritical model system and I will 
give some hints about this mechanism at work also for the random field ising 
model. 
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Figure 3.9: Transition curves m(T), A = 3 onto a disassortative bimodal ran- 
dom graph of size N = 10 4 . From Monte carlo simulations (points) and BP 
numerical calculations(lines). 



The random field ising model 

In this model, ferromagnetic interacting Ising spins Si = ±1 are subject to local 
quenched fields, the hamiltonian being: 



The hi are i.i.d. random variables, distributed in a bimodal fashion p{h{) = 
l/2(<5fc. 4! 7j + Shi.-h)- This model was introduced to study disordered magnets 
and it is the minimal model to describe phase transition in systems that show 
crackling rtoise[68j. The response of this model to time- varying external field 
has three regimes: 

• At high h the system responds as a paramagnet, i.e. its magnetization 
follows the external field in a continuous way. 

• At low h the system responds as a magnet. It responds as a paramagnet 
for high T and as a ferromagnet for low T, i.e. the magnetization jumps 
discontinuosly depending on the sign of the external field. 

• At intermediate h the magnetization follows the external field with little 
jumps. The spin flip dynamics is characterized by avalanche events whose 
size in scale free [69 . 




(3.20) 



<i,3> 



The dynamics of each spin is the result of a possible competition between the 
local field and the effective field coming from the interaction with the neighbors. 
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The study of the model on a general random graph with degree distribution 
P(k) follows the same lines of the Blume-Capel model. Hence, in the Curie- 
Weiss scheme, we have the self consistent equations for m, m v , i.e. respectively 
the average magnetization of a randomly chosen node and that one of a node 
reached following a randomly chosen link: 

m v = i ^2 (tanh(j3(km v + h)) + tanh(/3(km v - h))) (3.21) 

k 

m = - P(k){tanh(/3(km v + h)) + tanh(f3(km v ~ h))) (3.22) 

k 

In general, expanding in power of m v the rhs, we can find the critical second 
order A-line = cosh 2 ((3h), until tanh 2 ((3h) < ±. Then, at T c = 2/3^^, 

h c = Tctanh' 1 (l/Vz) there is a tricritical point, after which the transition 
becomes first-order. Again, for a power law degree distribution a reentrant 
phase diagram is found (fig l3.10[ left). 
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Figure 3.10: Left: phase diagram (T,h) for the random field ising model on 
a random graph with degree distribution P(k) cx fc~ 3 - 2 , k m i n — 2 k ma x = 
100. From CW approximation. Right: transition curves from BP calculations. 
The inset shows m(T) (H — 2.5) for different microscopic realizations of the 
quenched local fields. 
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It is possible to set up a BP approach to improve this approximation. We 
have the recursive equations for the partition function: 

Z = E e * S °II*W (3-23) 

gij ( Si )=J2 eKSiSi+hiS)) II 93k(sj) (3.24) 

Then we can write gij(si) = Aije l3uijSi and we have the equations: 

2f3 Uij = log{ ^ --) (3.25) 

cosh(/3(-l + hj + J2 k ^ u jk)) 
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from which we can get the magnetization per node tuq — tanh(/3(ho + itoi)- 
Fig |3.10l (right) shows the transition curves m(T) for a random graph with 
degree distribution P(k) oc k~ 3 - 2 , k m i n — 2 N — 10 4 . At H — 2.5 there is a weak 
reentrant phenomenon, but the form of the curves m(T) is strongly dependent 
on the microscopic realization of the quenched local fields(inset). However the 
phase diagram of this model has a complex structure of singularities even on 
homogeneous graph [7T] and further investigations are needed. 
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Chapter 4 



Volatility and evolution of 
social networks 

The idea of applying methods and concepts from natural science, in particular 
statistical physics, to the study of social systems has a long history [72] . 

Many social and economic phenomena have an inherent network dimension |73j. 
The question of embedness of such phenomena in social networks has been ad- 
dressed directly only in recent times, because of the recent technological devel- 
opment in storing and hadling large dataset of informations. 

Social networks have complex structures that are evolving in time. In par- 
ticular, the same kind of network can show qualitatively different structures, 
sparse and disconnected vs dense and connected. 

After a brief introduction on the structure and evolution of social networks, 
we will present the mechanism of coevolution to model their formation trough a 
class of models proposed by G.Ehrhardt et al[90]. In these, the evolution of the 
network is coupled with the dynamics defined on top of it. A feedback effect 
can trigger the apparence of different phases, disordered and disconnected in 
clusters or ordered and connected, respectively, in a discontinuous way. 

Within the simplest model of this class, I will show how the kind of volatility, 
i.e. the rate at which nodes and/or links disappear, affects the evolution of 
the network [9 1. It is found that when the volatility is mostly node-based the 
emergence of an ordered phase is definitively suppressed. 

4.1 Complex social networks 

The recent surge of interest of the worldwide public opinion on social networks 
perhaps has its motivations in the spreading of virtual settings like Facebook. 
Anyway, the network dimension is important in many concrete aspects of social 
and economic life. Examples range from informal contacts in labour market [75] 
and peer effects in promoting (anti-)social behaviors |83j to inter-firm agreement 
for R&D [55]. This issue of embeddedness was addressed in early times [8U] . 
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but only recently it is possible to deal with it in practice thanks to the recent 
technological development in informatics. 

Let's consider as an example the question of the social dimension in science 
research. Some insights about it can be gained from the study of coathourship 
networks. Here the nodes are scholars, that are connected by a link if they wrote 
a paper togheter. Ref . [76] reports on the analysis of: 

• A network of coauthorship of papers in the Medline bibliographical database 
from 1995 to 1999. Medline is a widely used and compendious database 
for covering biomedical research. 

• A networks of coauthorships of physicists assembled from papers posted 
on the widely used Physics E-print archive at Cornell university between 
1995 and 1999. 

• A collaboration network of mathematicians compiled from databases man- 
tained by the journal Mathematical Reviews, covering the period from 1940 
to the present without break, from [77]. 
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Figure 4.1: Top: statistical features of the coauthorship networks analized in 
[76] . Bottom: Evolution of the statistical features of the coauthorship networks 
of economists analized in [51] 
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Figure 4.2: Distribution of the number of collaborators per scientists in the 
coauthorship networks analizcd in [76 



A summary of the basic statistics of these networks is given in table PlFl. 
These reveal many interesting features about academic communities. All the 
three communities have a largest connected component that cover the great part 
of the graph, with rather small average distances and diameters. The statement 
of scientific research as a common and collective enterprise immediately comes 
up in a graphical way. The average number of authors per paper and the average 
number of collaborators is bigger in biology and smaller in mathemathics, with 
physics in between. This should be presumably a result of different methods 
of research. Biological research in fact consists mostly of experimental work by 
large groups of laboratory scientists. Mathematical research instead consists of 
theoretical work done primarly by individuals alone or by pairs of collaborators. 
Physics should be a combination of the two. The distribution of collaborators 
per scientists is shown in fig |4.21 They all show fat-tails, showing the presence 
of few scientists with a lot of collaborations and probably having in them a 
leading role. The average clustering coefficients, i.e. the probability that two 
collaborators of a researcher are collaborators themselves are also rather differ- 
ent in different fields. This is very high in physics 0.43, and quite low in biology 
0.06. The finer details of these networks show morevoer interesting community 
structures [78] (see e.g. fig I4.3|) . 

Finally, these networks are subject to a dynamical evolution. The evolution 
of the coauthorhip networks of economists from the Econlit database is analyzed 
in (84]. The basic statistical features are shown again in fig !4. If bottom). The 
largest connected component is growing, with emerging features similar to the 
previous cases, and the authors state of the research in economy as an emerging 



1 There are no precise data about the number of papers in the mathematics database. 
However, according to [77] they should be around 1.6 million. 
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Figure 4.3: The largest component in the network of collaboarations in the 
Santa Fe institute. From [75] 



small world, as it is called a compact network, whose diameters and average 
distances are small with respect to the size. 

If the analysis of the structure of large and complex social networks needs 
statistical methods, the analysis of their evolution can gain insights from statis- 
tical mechanics modeling. 



4.2 Models of co-evolving networks 

The competition between order and disorder is by no means restricted to physics [79]. 
Also economies and societies - as systems of many interacting individuals - or- 
ganize themselves in different (macroscopic) states, with different degrees of 
order - informally interpreted as coordination on social norms, compliance with 
laws or conventions [74] . Besides all its inherent complexity, one important el- 
ement of additional richness is that the relation between the degree of order 
in a society and the cohesion of the underlying social network is not unidirec- 
tional as in physics, where the topology of interactions is fixed. The structure of 
the networks in these phenomena is dynamically shaped by incentives of agents 
(nodes), be they individuals or organizations, who establish bilateral interac- 
tions (links) when profitable. In addition, this interplay typically takes place 
in a volatile environment. That is, the favourable circumstances that led at 
the same point to the formation of a particular link may later on deteriorate, 
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causing the removal or rewiring of that link. This combination of factors raises 
a number of interesting issues in statistical physics, as the collective behavior of 
the interacting degrees of freedom may radically change when they are coupled 
to the dynamics of the network they are defined on. 

I will review here the results of ref.[90]. In all the models defined there, 
the feedback between nodes and networks dynamics arises from assuming that 
the formation of a link requires some sort of similarity or proximity of the 
two parties. This captures different situation. For example, in cases where 
trust is essential in the establishment of new relationships (e.g. in crime or 
trade networks), linking may be facilitated by common acquaintances or by 
the existence of a chain of acquaintances joining the two parties. In other 
cases (e.g. in R&D or scientific networks) a common language, methodology, 
or comparable level of technical competence may be required for the link to 
be feasible or fruitful to both parties. This class of models reveals a generic 
behavior characterized by a discontinuous transition from an uncoordinated 
state characterized by a sparse network, to a coordinated state on a dense 
network. As discussed in Ref. [5D|, this agrees with anecdotical evidence on 
the observation of sharp transitions [84] . [85] and resilience properties [86], [87] of 
some social networks. However, our focus here will be mostly on the statistical 
phenomenon, than on its interpretation in socio-economic terms, given that the 
phenomenology bears a formal similarity with the liquid-gas transition. 

Consider a population of N agents. They form the nodes i — 1, ...,N of a 
network that is described by an undirected graph. The formation and destruc- 
tion of links proceedes by the following steps: 

• Each node i attempts to establish a new link with a randomly chosen node 
j at rate 77. 

• Given a notion of a social distance dij between nodes i and j , if dij < d 
the link is formed, otherwise it is formed with probability e. 

• Links are destroyed at rate A 

It is possible to set up a mean field approximation. It consists in neglect- 
ing degree correlations between neighbouring nodes, i.e. we approximate the 
network with a random graph. Random graphs are characterized only by their 
degree distribution P(k). We make the hypothesis that the p(k) satisfies a 
master equation whose rates are: 



The factor 2 comes because each node can either initiate or receive a new 
link. The definition of the social distance should depend upon the specific 
phenomena we are looking at. 

A first simple specification can be with dij being the geodetic distance on 
the graph, and n = N — 2. This describes a situation in which the formation 



w(k -t k — 1) = Xk 
w(k -)• k + 1) = 2r](e + (1 - e)P{d ij < d)) 



(4.1) 
(4.2) 
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of new links is strongly influenced by proximity on the graph. If i and j are in 
different components the rate of link formation is 2e7/, otherwise is 2rj. In the 
large N limit the latter only occurs if the graph has a giant component with a 
finite fraction 7 of the nodes. For random graphs (see e.g. [73]) 7 = 1 — <f>(u), 
where 0(s) = J2kP(k) sk 1S the generating function, and u is the probability that 
a link, followed in one direction, does not lead to the giant component. This 
latter satisfies 

u = 0»M(1) (4.3) 

Hence u k is the probability that an agent with degree k is not in the giant 
component, and then 

w(k k + 1) = 2r](e + (1 - e) 7 (l - u k )) (4.4) 

The stationary state condition brings the equation for <f>: 

\<P'(s) = 2r)(e + (1 - c)7)^(«) - 2r?(l - e) 7 0(ws) (4.5) 

which can be solved numerically to the desidered accuracy. The solution of this 
equation is summarized in fig l4.4l Either one or three solutions are found, de- 
pending on the parameters. In the latter case the intermediate solution (dashed 
line in fig l4.4[) is unstable and it separates the basins of attraction of the two 
stable solutions within this mean field approach. The solution is exact when 
there is no giant component, and numerical simulations show that the approach 
is very accurate away from the phase transition. 

Next let's consider a setup in which dij reflects the proximity of nodes in 
terms of some continuous, non negative attributes hi. In short, the attributes 
could represent the level of technical expertise of two firms involved in a R&D 
partnership, or the competence of two researchers involved in a joint project. 
Each agents updates his attribute hi with a rate v, that we suppose much larger 
than A and r\. Let's explore a setting of best practice imitation (BP) where 
individuals aim at improving in the direction of increasing hi by on site efforts 
and by learning from their neighbors. We posit that hi(t + ) = maxNi{hj(t)} + 
T)(t)i, where rji are i.i.d. gaussian random variables with zero mean and variance 
A, that capture idyosincratic change of expertise due to «'s own (say research) 
efforts. We set the distance dij = \hi — hj\. Fig 14.51 reports typical results of 
simulations of this model. As in the previous model, there is a discontinuous 
transition between a sparse and dense network state, characterized by hysteresis 
effects. In the stationary state h = (hi) grows linearly in time with velocity v. 
Notably the growth is much faster in the dense state that in the sparse one. 
This model exihibits an interplay between the process on the network, i.e. the 
dynamics of the hi and the network evolution. It is this interdependence and 
the corresponding positive feedback that produces the discontinuous transition 
and phase coexistence. 

The last specification I consider is such that link formation requires some 
form of coordination or compatibility. For example, a profitable interaction may 
fail to occur if the two parties do not speak the same language and/or do not 
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adopt compatible technologies or standards. We can characterize each agent i 
with a variable Oi which represents the social norm (convention or technological 
standard) adopted. There are q possible social norms, i.e. m € {1, ...,q}. I 
will call them colors. We impose that the formation of a new link between i and 
j requires that <7j = aj. The color of a node is updated with rate v to the 
color of any of its neighbors, unless the node is isolated. In the latter case the 
nodes takes a random color. In terms of statistical physics, the model can be 
thought of as a q state Potts model defined on a graph of N nodes, with T = 0, 
that evolves in a coupled fashion to the dynamics of the system. This model is 
solved exactly in |90j , but given its simplicity, we will see in the next paragraph 
how to generalize it to take into account the possibility of agents'turnover, i.e. 
a node-based volatility. 



4.3 Node-based volatility 

Indeed, the effect of volatility was up to now limited to link removal, but the 
turnover of agents (i.e. node removal and arrival) may be an important factor 
in many real systems. In order to investigate this question, we concentrate 




Figure 4.4: Mean degree (k) as a function of A for e = 0.2, = 1, when is 
the distance on the graph and d — N — 2. Lines are from mean field theory, 
points from simulations, starting from both low and high connected phases. 
Inset: phase diagram from the mean field. Coexistence occurs within the shaded 
region , whereas above(below) only the sparse(dense) state is stable. Numerical 
simulation agree qualitatively The high(low) density state is stable up (down) 
to the points marked with X (0) and is unstable at points marked with 0(+)- 
From 190] 
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Figure 4.5: Mean degree (k) and growth rate v as a function of rj from numerical 
simulations of the BP model. Shown are simulations with N = 500 (plusses) 
and 1000 (crosses). Arrows denote the approximate point at which the system 
jumps from one phase to the other. Here e = 0.001, A = 0.1 and similarity 
treshold d = 2. From [50] 



on the simplest model for which a full analytic treatment is possible. In the 
concluding section, we argue that this qualitative change is expected in a wider 
class of model, and it can have much stronger effects. I consider the model 
of coordination sketched in the end of the last paragraph, but I generalize it, 
considering the possiblity that with rate a all the links of a node disappear. This 
will show how the alternative assumptions of link or node based volatility have 
profound effects on the dynamics of network formation [91 . In the following I 
set for sake of simplicity A = 1 and I rescale by a factor 2 the link creation rate 

Therefore, the parameter a interpolates between two kinds of volatility. For 
a = volatility only affects links and for a 3> 1 it mostly affects nodes. As 
observed in Ref. [90], the color update rule is effective only for isolated nodes, 
in the long run, and in that case the color is drawn at random. Since only links 
between same type agents are created, after a transient all nodes are either 
isolated, or connected to nodes of the same color. Therefore the particular way 
in which the neighbor is chosen is immaterial. For example, both a majority 
rule (most frequent color) or a voter-type rule (random neighbor) would give 
the same dynamics. The model can be generalized to a probabilistic update 
rule for the colors introducing a finite temperature T (see [90]). Results do not 
change considerably as long as T is small enough, so we shall confine ourselves 
to the T = case. 

Ref. [90 has shown that for a — 0, the system shows an hysteretic transition 
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in rj from a symmetric to an asymmetric stat^l- The symmetric state is char- 
acterized by a sparse network, with average degree (k) < 1, with a symmetric 
distribution of colors. In the asymmetric state, instead, a dense network with 
(k) > 1 arises, along with a dominant color, which is adopted by agents more 
frequently than the others. All the colors are a priori equivalent and the fact 
that only one is selected is a simple example of a spontaneous simmetry breaking. 
The dominant component is selected by random fluctuations and is stabilized 
by the feedback mechanism between link formation (which is more frequently 
successful for nodes of the dominant component) and the freezing of the colors 
of connected nodes (akin to the ferromagnetic interaction in Potts models). In 
this sense, the model shows how order and disorder are intimately related with 
the dynamics of the social network in a volatile environment. 

In what follows, we solve the model in the stationary state for N — > oo, for all 
the values of a. We find that the a = behavior is generic for all a < 1, but the 
transition is softened as a increases. For a > 1 instead we show that the system 
is always in the symmetric phase. Hence, in terms of statistical mechanics, 
a = 1 is a second order critical point separating a phase with spontaneously 
broken symmetry from a symmetric phase. 

If we call nfc. CT the density of nodes with k links and color a = 1, . . . , q we 
have the following rate equations: 

nk.a = {k + l)nfc+i, CT — fcrifc )CT - ank,a + 

+ x (7 (nk-i,a -n k<(7 ) (4.6) 
n-o.cr = a n k , a + ni ;ff - x a n ^ a + 

k>Q 

q 

9 er' = l 

where, for future convenience, we have introduced the dynamical variables 

oo 

x<j = V^2n>k,a- (4.8) 

fc=0 

Making the sum over all k of these equations and multiplying by r\ we find 

i 

x a = — (no,<r' - no,<r) (4.9) 
q ^— ' 

which implies that, in the stationary state, each component has the same frac- 
tion no, CT = rio/q of disconnected (k — 0) nodes, it is straightforward to derive 
an equations for the characteristic functions Tr a (s) of the degree distribution 
Pa(k) = nk.a I Y] q n qta of the component a. In the stationary state this reads: 

uTT 

(1 - s)-^ = [a + x a {\ - s)W{s) - a. (4.10) 
as 

2 1 will recover it as a special case 
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The stationary solution is found by direct integration: 

7r CT (s) = a f dzz a - 1 e- a '^-'^ 1 -^ (4.11) 
Jo 

It is easy to see that this interpolates between a Poisson distribution, 7r CT (s) = 
e x CT (s-i) £ or q, _^ o, which coincides with the result of Ref. [90], and an ex- 
ponential distribution ^(s) = a/[a + x a (l — s)] for a —¥ oo. The latter limit 
is derived upon changing variables to y — z a in Eq. (|4.11j) and expanding 
1 — y x l a ~ — ilogy in the argument of the exponential. Notice also that the 
average degree in component a is (k) a = 7r£.(l) = x a /(l + a). This is pre- 
cisely what one expects from balance of link creation and destruction of links 
in component a. 

Observing that ^(0) = r/ 1 -^- = W e find an equation for x a in the 
stationary state, which reads 

GJx a ) = ax a [ 1 duu a ~ 1 e x ^ u ~ 1 ^ = (4.12) 

Jo q 

Notice that the r.h.s. of Eq. (|4.12|) is independent of a. The variables Xfj are 
determined by Eq. (|4.12[) and the normalization condition, which takes the form 

3 

5> CT = r,. (4.13) 

(7=1 

The properties of the solutions of Eqs. (|4. 1214. 13[) depend on the behavior of 
the function G a (x), which are discussed in the appendix, and can be classified 
in symmetric and asymmetric solutions. 



4.3.1 a > 1: The symmetric solution 

For a > 1 the function G a (x) is a monotone increasing function. 
The function G a (x) can be written as 



G a {x) — a I dz ( 1 



ct-l 

„ — z 



For a > 1 we have 

dG a a(a- 1) f x 



dx 



e- z > 



Hence Eq. (|4.12[) has a single solution and Eq. (|4. 13[) implies that x a = ij/q 
for all components a. Notice also that 



d G a (x) 
dx x 



a I duu (1 — u) a 1 e 
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i.e. no = G a (j] / q) / (j) / q) in the symmetric solution is a decreasing function of 
n/q. In addition G a (x) ~ x for x -C 1, i.e. no ~~ ► 1. Hence Eq. (|4J2|) yields the 
total fraction of disconnected nodes 

no = -G a (n/q) 
V 

as a function of the parameters q, a and n. We can analyze the stability of the 
symmetric solution recalling that rjno.a — G a (x a ). Then Eq. (|4.9j) becomes a 
dynamical equation for x a 

i 

x a = - V [G a {x a ,) - G a {x a )] . (4.14) 

Linear stability of the symmetric solution is addressed by setting x a = r\j 'q + e ai 
with J2 a ta ~ 0- Then to linear order 

q 

^ = -G' a ( V /q) J2 t £ -' - e -l = -vG'^/qy*. (4.15) 

" tr'=l 

Hence, as long as G a {x) is an increasing function of x, the symmetric solution 
is stable. This is always the case for a > 1, as we shall see, it fails to hold for 
a < 1. 

4.3.2 a < 1: The asymmetric solution 

For a < 1 the symmetric solution still exists. However the function G a (x) 
now has a maximum for some xo(a) and G a (x) — > a from above as a; — > oo. 
Therefore the symmetric solution becomes unstable when r\ > rj + where 

i] + = qx (a) (4.16) 

because beyond that point G' a (n/q) < 0. 

The occurrence of a maximum in G a also implies that Eq. (|4.12l) admits 
solutions with x a = X- < Xa(a) for some tr's and x — x+ > xo(a) for the 
other components. Since x a is related to the density of a component er, we 
shall call a component dense if and diluted if x CT = x_. As in Rcf. 

|90j . all solutions with more than one dense component are unstable. Indeed, 
by the same argument used to analyze the stability of the symmetric solution, 
a perturbation with e a — for all diluted components would grow as i a = 
—vG' a {x + )e a on all dense components. These unstable modes correspond to 
density fluctuations across dense components. Once one of these components 
acquires slightly more mass, the density of links in it increases, which makes it 
less likely for nodes in this component to become isolated. At the same time, 
this component will recruit isolated nodes at a slightly faster pace, due to its 
larger density. It is then intuitively clear that the initial density perturbation 
will grow unboundedly. 
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These unstable modes (G' a (x + ) > implies e+ > 0) are clearly absent in the 
solution with only one dense component. These are the asymmetric solutions 
we shall focus on in what follows. There are q of them, depending on which 
color is associated with the dense component. The variables x± are determined 
by the system of equations 



G a {x+) = G a (x_) 
x+ + (q — l)x- = Tj 



(4.17) 
(4.18) 



This solution is shown in Fig. 14.61 
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Figure 4.6: Solutions x± as a function of r\ for q = 10 and a — 0.4. The dashed 
line x = rj/q separating the two curves is the symmetric solution. 

Actually, of the two asymmetric solutions the one with x+ decreasing with 77 
is clearly unphysical as this would have a connected component with an average 
degree (k) a = x + / {1 + a) which decreases with the rate rj with which links are 
formed. As in ref. |90j . it is easy to see that only solutions with x+ increasing 
in 77 are stable. Indeed, regarding rj and X- as functions of x + in Eq. (|4.18[) we 
find 



dx- G' a (x-) + (q-l)G' a (x + ) 



dx-i 



G' a (x-) 



Consider perturbations of the form x„ = x + + e for the dense component and 
x a = £_ — e/(q — 1) for the others. Then by a derivation analogous to that 
leading to Eq. (|4.15[) . we find 



-~[G' a (x-) + (q 



l)G' a (x+)]e 



v n> ( \ dr l 
--G a {x-)- — e. 

q dx+ 
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Given that G' a (x-) > 0, this implies that on solutions with x + decreasing with 
77, the perturbation e grows unboundedly. 

The asymmetric solution ceases to exist for 77 < ?7_[f|. In the region 77 6 
[?/_,T7+] both the symmetric and the asymmetric solutions co-exist. The coex- 
istence region, in the a, 77 plane is reported in Fig. 14.81 

The practical relevance of the results derived so far is best discussed intro- 
ducing an order parameter 

m = x +~ x - (4.19) 
V 

which is the difference in the density of the dense and diluted components. This 
vanishes in the symmetric phase and is non-zero in the asymmetric one. In Fig. 
14.71 where we report the behavior of the average degree of the network 

w=E^=T^ 1+(9 : 1)m2 - ( 4 - 2 °) 

' 1 + a q 




Figure 4.7: Mean degree < k > as a function of 77/A for a system with q = 10 
colors, for a — and 0.2, simulations are for systems of 1000 nodes. 

Fig. 14.71 shows that as 77 sweeps through the coexistence region the system 
undergoes an hysteresis loop: the degree jumps from low to high values at 77+ as 
77 is increased whereas when 77 decreases from large values, the network collapses 
back to the symmetric phase when ?7_ is crossed. In the case a = [90], the 
symmetric phase is characterized by sparse networks, with a vanishing giant 



3 We note, in passing, that the condition dr]/dx+ = provides an equation which allows to 
determine t?_. 
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component. This is no more true when < a < 1, specially close to rj + 0. 
Numerical simulations fully confirm this picture, even though for finite systems 
the symmetric (asymmetric) phase is meta-stable close to rj + (?y_ ) and therefore 
the transition occurs for lower (larger) values of rj. 



100 




Figure 4.8: Phase diagram for q = 10. The symmetric phase extends below and 
to the right of the (full) line r\- (a) whereas above the (dashed) line rj + (a) only 
the asymmetric phase is stable. The coexistence region, where both phases are 
stable, is delimited by the two curves. 



4.3.3 The critical region: a ~ 1 

The behavior of the order parameter m on the critical lines which confine the 
coexistence region is shown in Fig. 14.91 This shows that the transition is con- 
tinuous but with a peculiar critical behavior. For a = 1 — e we can approximate 



J du l-elog(l- ~) 



G a (x)~(l-e) 



= (l-e)(l-e-* + e(E l (x)- 1 )) 

where Ei(x) is the exponential integral function, and for e 
and Ei(x) ~ — i. Hence 

G Q ~ (l~e){l-e- x + e/x) 



we have x± — > oo 



Exactly at the critical point r\ = qxq, where is such that G' a (xo) 
have e-^-y = 1 from which we can get xo — — log e + 2 log | log e| . 



0. We 



4 Indeed the condition for the presence of a giant component is (k(k — 1)) CT > (k) a which, 
by a straightforward calculation, reads r] > q(l + a/2). At the critical point ?y+ = qxo(ct) this 
reads xg(a) > 1 + a/2 which holds true for all a > 0. 
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From G a (x+) — G a (x~) and the expressions of X- and x+ with respect to 
xq and m, we finally have 

m~ c/x (a) ~ |log(l -a)| _1 . (4.21) 
where c is given self-consistently by: 

c = e c (l-e- qc )/q 

In terms of the usual description of critical phenomena, where m ~ |1 — , 
this model is consistent with an exponent /3 = + . Indeed, the singular behavior 
of m is very close to that of a first order phase transition. 




Figure 4.9: Order parameter m on the boundary of the coexistence region rj- 
(full line) and r/ + (dashed line) as a function of a for q = 10. 



4.3.4 Conclusions 

The introduction of node volatility, in the simple model discussed here, makes 
the transition from a symmetric (disordered) diluted network to an asymmet- 
ric (ordered) dense network less sharp. Indeed when node volatility dominates 
(a > 1) the transition disappears altogether, and the symmetric (disordered) 
state prevails. The phenomenology is strongly reminiscent of that of first or- 
der phase transitions (e.g. liquid-gas or paramagnet-ferromagnet) though the 
critical behavior is highly non-trivial. 

The virtue of the particular model studied is that it allows a detailed analytic 
approach which allows one to gain insight on all aspects of its behavior. This 
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model belongs to a general class of models which embody a generic feedback 
mechanism between the nodes and the network they are embedded in, which 
can be expressed in the following way: while the network promotes similarity or 
proximity between nodes, proximity or similarity enhances link formation. This 
feedback allows the system to cope with environmental volatility, which acts 
removing links at a constant rate. Interestingly, the emergence of an "ordered" 
state plays a key role in this evolutionary struggle. We believe the general 
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Figure 4.10: Mean degree as a function of the rate £ of formation of links with 
neighbours of neighbours, for N = 1000 (A = 1). Top: rj = 0.01, Bottom: 
r) = 0.1. 

findings discussed here will extend to the general class of models of Ref. [50] • 
In particular, we expect the phase transition to be blurred by the effect of node 
volatility and to disappear when the latter exceed a particular threshold. 

Actually, Fig. I4.10l shows that this is the case even for the model of Ref. [55] . 
This is a model where link creation occurs either by long distance search at rate 
r\ (as in the model discussed here) or through local search (on second neighbors) 
at rate £. Again links decay at unit rate. We refer the interested reader to 
Ref. [89] for further details, for the present discussion let it suffice to say that 
the effects of (link) volatility are contrasted by the creation of a dense network 
with small-world features (a somewhat similar model with node volatility has 
been considered in Ref. 88 ) . Fig. 14.101 shows that the effects of node volatility 
are very strong. Indeed, even a very small a reduces considerably the size of 
the coexistence region and the value a c at which the latter disappears is also 
relatively small. 

These results suggest that node volatility is indeed a relevant effect in the 
co-evolution of socio-economic networks, as it may affect in dramatic ways the 
ability of the system to reach a dense and/or coordinated state. 



Chapter 5 

Conclusions 



In this thesis each chapter is mostly independent and self-contained. Each of 
them is in fact referring to a specific phenomenology. Is there something in 
common among phase transitions in physical materials, congestion phenomena 
in informatic systems and the evolution of social networks? 

I studied all of them using interacting dynamical models on heterogeneous 
graphs with the use of statistical mechanics techniques and concepts. The wide 
applications of lattice models from statistical mechanics has its main reason in 
the fact that network based rappresentations are widely used to describe many 
real complex systems. 

This thesis is about how a certain degree of heterogeneity in the underlying 
topology can affect the collective statistical behavior of a system. It is not 
intended as a review on it, rather I showed practically that this question emerges 
spontaneously and gives insights in specific instances. 

In the first chapter I showed how to give a statistical mechanics perspective 
to the problem of congestion in large communication networked system. This 
comes out from a natural extension of queuing network theory to large systems 
and to congested states. In order to do it, the use of statistical networks' ensem- 
bles and the concept of congestion as a phase transition were really important. 
In this chapter we have a specific example of the fact that the collective behavior 
of a system can depend crucially on the underlying structure, e.g. traffic control 
is uneffective in homogeneous networks. 

Usually it is believed that the equilibrium distinctive features of statistical 
physics systems should depend on the simmctries of the internal degrees of free- 
dom and only on the dimension of the spatial structure. However the results on 
congestion phenomena suggest that in out of equilibrium systems the collective 
behavior could depend even on the details of the structure. I showed in the sec- 
ond chapter through a simple model of kinetically constrained spins subjected 
to a dynamical arrest, how a simple dilution of the underlying graph can change 
completely the nature of this transition. In the context of mean field models 
for the dynamical glass transition we can have bootstrap or simple percolation 
transition on homogeneous or heterogeneous structures, respectively. 
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Given their general nature, the dependence of the collective properties of 
simple interacting models on the underlying graph is interesting per se, without 
referring to a specific phenomenology. In the third chapter, I showed that the 
equilibrium features of tricritical model systems can change dramatically if the 
underlying graph has a certain degree of heterogeneity. The usual entropy ratio 
of the ordered and the disordered phase can invert on some graphs. There is an 
inverse phase transition, by which tricritical model systems becomes disordered 
upon cooling. I showed a mechanism that trigger this phenomenon, based on 
the freezing of sparse subgraphs. If they are crucial for the connectivity, the 
overall graph of interactions can be disconnected by cooling. 

Up to this point I discussed cases in which the behavior of a system is 
affected by the underlying structure, in particular this last is fixed. But where 
a given structure of interactions comes from? In social networks the graph itself 
changes in time with an evolution that can be coupled with the dynamics defined 
on top of it. In the last chapter we exploited a nice analogy with statistical 
physics in this context. Models of coevolving social networks show discontinuous 
transitions between sparse and dense structures, with hysteresis and coexistence 
phenomena. I showed a mechanism that dump this transition, up to a critical 
point like in the Van der Waals picture of the liquid-gas transition. 

Then, apart from the specific insights that can be obtained from applying 
statistical mechanics to such specific instances, is there something more general 
that we can get? 

In the introduction I gave the examples of epidemic spreading processes and 
of the Ising model as model systems that show a phase transition whose behavior 
is affected in a non-trivial way by the heterogeneity of the underlying graph. 
The critical point of these models scales with the system size in heterogeneous 
graphs in a way such that large enough systems are always in practice in the 
non-trivial phase. In the SIS model the nodes of a network can be susceptible 
(S) or infected (I), respectively. An infected node can infect its neighbors with 
rate v. Infected nodes recover from the infection with rate 1. These rules define 
a dynamical process of spreading that, for a given v and initial conditions, can 
end up in a state that can be characterized by the fraction of infected nodes <f>i . 
If 0/ = the spreading of the infection is stopped (this is an absorbing state). 
For large enough v we have a final state cf>] > 0, there is a continuous transition 
whose transition point, within a mean field approximation on random graphs 



is® 




(5.1) 



The critical temperature on random graphs [5] of the Ising model is 



1 




(k 2 ) 



)• 



(5.2) 



(fc 2 )-2(fc) 



These equations show that the collective behavior of such model systems can 
be ruled by the tails of the degree distribution of the underlying graph. 
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This is not the case in general. Here, in the context of the queuing network 
theory and of tricritical spin models I showed an analogous parallel. For these 
models, that show continuous and discontinuous transitions, there is a rather 
different behavior. Different parts of the same system can be in different phases. 
In fact the mean field analysis on heterogenenous graphs of both models is char- 
acterized by a cut-off degree such that only nodes whose degree is higher than it 
are in the non-trivial phase, congested or magnetized, respectively. In the range 
of parameters such that the transition is continuous, the behavior of the system 
is still ruled by high degree nodes. But, when the transition is discontinuous, 
their behavior is ruled by the central body of the degree distribution. In queu- 
ing network theory on random graphs, the critical inserction rate of packets per 
node p c scales according to: 



Where k m and ku are the minimum and the maximum of the degree distri- 
bution. The chemical potential at the transition point A c of the Blume-Capel 
model on a random graph scales, within a mean field approximation, according 
to: 



This difference in turn can trigger highly non-trivial phenomena, like inverse 
phase transitions in tricritical spin models or mixed phase transitions in the 
queuing networks. It should be interesting to test the general validity of this 
picture. 




fik m /(k) discontinuous, high traffic control. 



continuous, low traffic control. 



(5.3) 




2Tlog(/3-^y- — 1) for the continuous branch. 
(k) around T=0. 



(5.4) 



CHAPTER 5. CONCLUSIONS 



Acknowledgements 



I would like to thank the SISSA and ICTP institutions for their stimulating 
environments. I acknowledge G.Mussardo for the idea and concrete realization 
of this phd curriculum in statistical physics. Among the many interesting people 
that I met during this period, I would like to thank M.Sellitto, J.J.Arenzon, 
G.Bianconi and D.Helbing. I thank M.Barthelemy that accepted to be the 
external referees of this thesis. I thank all my collegues and friends in SISSA 
and ICTP, in particular Serena, Fabio, Raffo, Elena, Pier and Jacopo . I would 
like to thank my boss Matteo that was always showing me the "right spirit" 
in doing this job. A special thank to Luca Dall'Asta for his really valuable 
collaboration and patience all along this period. I thank A.Barato and L.Leuzzi 
for partial reviews of this manuscript. 

Un abbraccio ed un saluto alia mia famiglia, in particolare a Ludovica, un 
abbraccio ed un saluto a tutti gli amici e alia "famiglia" di Trieste ed inhnc, un 
bacio a Maya! 



73 



CHAPTER 5. CONCLUSIONS 



Bibliography 



[1] G.Gallavotti, Enciclopedia delle scienze fisiche, in "meccanica statistica" , 
ed. Treccani (2001) 

[2] K.Sneppen and G.Zocchi, Physics in molecular biology Cambridge Uni- 
versity Press (2005) 

[3] R.N.Mantegna and H.E.Stanley, An introduction to econophysics Cam- 
bridge University Press (1999) 

[4] S.Mertens, Computational complexity for physicists in comp. in science 
and engeenering, vol 4, 3, (2002) 

[5] D.Helbing, Rev. Mod. Phys. 73, 10671141 (2001) 

[6] R Albert, AL Barabsi, Rev. Mod. Phys. 74, 4797 (2002) 

[7] SN Dorogovtsev, AV Goltsev, JFF Mendes, Rev. Mod. Phys. 80, 12751335 
(2008) 

A. Barrat, M. Barthelemy, A. Vespignani, Dynamical Processes on Com- 
plex Networks, Cambridge University Press, 2008. 

[8] R.Pastor-Satorras and A. Vespignani, Phys. Rev. Lett. 86, 32003203 (2001) 

[9] M. Leone, A. Vzquez, A. Vespignani and R. Zecchina, Eur. Phys. Jour. 

B, Vol 28, N. 2, 191-197 (2002) 

[10] http://en.wikipedia.Org/wiki/Category:Internet 

[11] A. Vespignani and R.Pastor-Satorras, Evolution and structure of the Inter- 
net: a statistical physicists approach, Cambridge university press (2004) 

[12] R.D.Smith. larXiv:0807.337l f3 (2008) 

[13] G.Bolch, S.Greiner, H. de Meir and K.S.Trivedi, queuing networks and 
markov chains, NY Wiley (2006) 



75 



76 



BIBLIOGRAPHY 



[14] D.De Martino, L.Dall'Asta, G.Bianconi and M.Marsili, Phys. Rev. E 79 
015101 (2009); D.De Martino, L.Dall'Asta, G.Bianconi and M.Marsili, J. 
Stat. Mech. P08023 (2009); D.De Martino, Proc. IEEE COMPENG010 
(2010) 



http : / / www. caida. org / home / 



D. Krioukov, F.Chung, K.C.Claffy, M.Fomcnko, A.Vespignani and 
W.Willinger, The workshop on Internet topology report, ACM SIGCOMM 
ComComm. Rev. 37:1 69-73 (2007) 

W.Leland,M.Taqqu,W.Willinger and D.Wilson, Proc. ACM SIG- 
COMM'93 183-193 (1993); K.Park and W.Willinger Self similar network 
traffic and performance evaluation chapt. 1, NY: Wiley (2000) 

W.Willinger et al., ACM SIGCOMM, ComComm. Rev. 25:4 100-113 
(1995) 

J.R.Jackson, OPERATIONS RESEARCH Vol. 5, No. 4, pp. 518-521 
(1957) 

M.Evans and T.Hanney, J.Phys.A: Math.Gen. 38 R195 (2005) 

M. A. de Menezes and A.-L. Barabasi, Phys. Rev. Lett, 92 028701 (2004); 
Z. Eisler, J. Kertesz, S.-H. Yook and A.-L. Barabasi, Europhys. Lett. 69, 
664670 (2005); J. Duch and A. Arenas, Phys. Rev. Lett. 96, 218702 (2006); 
S. Meloni, J. Gomez-Gardenes, V. Latora, and Y. Moreno, Phys. Rev. Lett. 
100 208701 (2008). 

A. Arenas, A.Diaz-Guilera, R.Guimera, Phys. Rev. Lett. 86 3196 (2001) 

P.Echenique, J. Gomez-Gardenes and Y.Moreno, Europhys. Lett. 71 325 
(2005) 

B. Bollobas, Random graphs, Cambridge university press (2001) 

B. A. Huberman, and R. M. Lukose, Science 277(5325), 535 (1997). 

G.Biroli, L.Berthier, Glasses and aging: a statistical mechanics perspec- 
tive, Enciclopedia of complexity and Systems science, Springer (2008) 

A.Cavagna, Phys. Rep. vol. 476 (2009) 

M.D.Ediger, C.A. Angell and S.R.Nagel J.Phys.Chem 100 13200 (1996) 
A.W.Kauzmann, Chem. Rev. 43, 219 (1948) 
R.Richert and C.A.Angell, J.Chem.Phys 108 21 (1998) 

E. R. Weeks, J. C. Crocker, A. C. Levitt, A. Schofield and D. A. Weitz, 
Science 287, 627 (2000) 



BIBLIOGRAPHY 



77 



[32] C.Donati, S.C.Glotzer, P.H.Poole, Phys. Rev. Lett 82 25 (1999) 
[33] E.Zaccarelli, J.Phys.: cond.mat. 19 (2007) 

[34] Coniglio, A., Fierro, A., Herrmann, H. J., Nicodemi, M. (eds) Unifying 
Concepts in Granular Media and Glasses (Elsevier, Amsterdam, 2004) 

[35] H.M.Jaeger, S.R.Nagel and R.PBehringer Rev.ModiPhys. 68 (1996) 

[36] P. Richard, M. Nicodemi, R. Delannay, P. Ribire and D. Bideau, Nature 
Materials 4, 121 - 128 (2005) 

[37] P.De Gennes, Scaling concepts in polymer physics, Cornell university press 
(1979) 

[38] D.Stauffcr, AAharony, Introduction to percolation theory, Taylor and 
Francis (1992) 

[39] T. Abete, A. de Candia, E. Del Gado, A. Fierro, and A. Coniglio Phys. 
Rev. Lett. 98, 088301 (2007) 

[40] K.Kim, K.Miyazaki and S.Saito, Europhysics lett. 88, 3, (2009) 
V.Krakoviack, Phy.rev.lett 94 065703 (2005) 

[41] M.Goldstein J.Chem.Phys. 51 3728, (1969) 

[42] R.Reichmann and P.Charbonneau, JSTAT P05013 (2005) 

[43] W.Gotze, J.Phys.: cond.mat 11 Al (1999) 

[44] T.Castellani and A.Cavagna JSTAT P05012 (2005) 

[45] M Mezard, G Parisi and M Virasoro Spin glass theory and beyond, World 
Scientific Lecture Notes in Physics (1986) 

[46] M Mezard, G Parisi Arxiv preprint larXiv:0910.2838l (2009) 

[47] G Parisi, F Zamponi Reviews of Modern Physics (2010) 

[48] F. Ritort, P. Sollich, Adv. Phys. , Vol. 52, Issue 4 (2003) 

[49] GH Fredrickson, HC Andersen, Phys.Rev.Lett. 53 (1984) 

[50] M Sellitto, G Biroli, C Toninelli, Europhys. Lett. 69 496 (2005) 

[51] J Chalupa , P L Leath and G R Reich, J. Phys. C: Solid State Phys. 12 
(1979) 

[52] N.Branco Jour, of Stat. Phys. Vol. 70, N. 3-4, 1035-1044 (1993) 
[53] J.J.Arenzon, D.De Martino, F.Caccioli and M.sellito, in preparation 
[54] W.Kob, HC. Andersen, Phys.Rev. E 48 (1993) 



78 BIBLIOGRAPHY 

[55] C.Toninelli and G.Biroli J.Stat.Phys., vol 126 no. 4 (2007) 

[56] FH Stillinger, PG Debenedetti, TM Truskctt J. Phys. Chcm. B, 2001 

[57] N.Schuppcr and N.M.Shnerb, Phys. Rev. E 72, 046107 (2005) 

[58] T Narayanan, A Kumar, Physics Reports, 249 (3). pp. 135-218 (1994) 

[59] C.S.Hudson Z.Phy.Chem.47, 113 (1905) 

[60] J.Hirschfelder,D.Stevenson and H.Eyring J.Chcm.Phys. 5 (1937) 

[61] J.C.Wheeler J.Chem.Phy. 62,433 (1975) 

[62] G.Tammann Kristallisieren und schmelzcn 26-46 (1903) 

[63] S Rastogi, GWH Hohne, A Kellers, Macromolecules, 32 (26) (1999) 

[64] M. Blume Phys. Rev. 141, 517524 (1966) 

[65] J.Park and M.E.J.Newmann, Phys. Rev. E 70, 066117 (2004) 
J.D.Noh, Phys. Rev. E 76, 026116 (2007) 

[66] A.Crisanti and L.Lcuzzi, Phys. Rev. Lett. 95, 087201 (2005) 

[67] G Bianconi, M Marsili J. Stat. Mcch. (2005) P06005 

[68] JP Sethna, KA Dahmen, CR Myers, Nature 410, 242-250 (2001) 

[69] S Sabhapandit, P Shukla, D Dhar,J.Stat.Phys. 98 (2000) 

[70] D.De Martino, S.Bradde, L.Dall'Asta and M. Marsili, in preparation 

[71] R.Bruinsma Phys. Rev B, vol 30, n 1 (1984) 

[72] P.Ball Complexus 1 190 (2003) 

[73] F.Vega-Rcdondo Complex social networks Cambridge university press 
(2007) 

[74] H. P. Young The Journal of Economic Perspectives, 10, 105-122, (Spring, 
1996) 

[75] Topa, G., Rev. Ec. Studies 68, 261 (2001). 

[76] M.E.J. Newman, PNAS, vol 101, 5200, (2004) 

[77] J.W.Grossman, Congressum Numerantium, 158 202-212 (2002) 

[78] M.Girvan and M.E.J. Newman, PNAS, vol 101, 5200, (2004) 

[79] C Castellano, S Fortunato, V Lorcto, Rev. Mod. Phys. 81, 591646 (2009) 

[80] M.Granovetter, Am. J. Sociol. 91, 481 (1985) 



BIBLIOGRAPHY 



79 



[81] C. Nardini, B. Kozma, A. Barrat, Rev. Lett. 100, 158701 (2008); F. 
Vazquez, V.M. Eguiluz, M. San Miguel, Phys. Rev. Lett. 100, 108702 
(2008). 

[82] T. Gross and B. Blasius, J. R. Soc. Interface 5, 259 (2008). 
[83] J.Crane, Am. J. Sociol. 96, 1226 (1991) 

[84] S.Goyal, M.J.van der Leij, J. L. Moraga- Gonzales, J. Polit. Econ. 114, 
403 (2006) 

[85] J.Hagedoorn, Research policy 31, 477 (2002) 

[86] A.Saxenian, Regional Advantage: culture and competition in Silicon Valley 
and route 128 (Harvard university press, Cambridge, MA, 1994) 

[87] Y.Bcnkler, Yale Law Journal 112 369 (2002) 

[88] J.Davidsen, H.Ebel and S.Bornholdt, Phy.Rev.Lett. 88, 12, 128701 (2002) 

[89] M.Marsili, F.Vega-Redondo and F.Slanina, Proc. Natl. Acad. Sci. U.S.A. 
101, 1439 (2004) 

[90] G.Ehrardt, M.Marsili and F.Vcga-Rcdondo, Phy.Rev. E 74, 036106 (2006) 
[91] D.De Martino and M.Marsili Eur. jour. phy. B 65 595-600 (2008) 



L 

q 



